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RECORDING APPARATUS AND CODING APPARATUS 
FIELD OF THE INVENTIO N 

The present invention relates to a recording apparatus and a 
cuding apparatus and, more particularly, to an apparatus for 
recording an audio video signal on a recording medium, and an 

ft 

apparatus for coding a video signal. 
BACKGROUND OF THE INVENTION 

On a playback-only DVD (Digital Video Disk) , coded data 
which is obtained by performing compressive coding on an audio 

video signal corresponding to a specific program or the like, is 

I 

recorded. This audio video signal includes an audio signal and a 
video signal, and coded audio data obtained ly coding the audio 
signal and coded video data obtained by coding the video signal 
are recorded on the DVD as the above-described coded data. 
Further, the coded audio. data and the coded video data are 
respectively packed. That is, these coded data are divided into 
plural pieces of data corresponding to first data units each 



bytes) . 
audio data 



having a predetermined data size (e.g., 2048 

In the following description, the coded 
corresponding to the first data units are referred to as audio 
packs, and the coded video data corresponding to the first data 
units are referred to as video packs. 

These audio packs and video packs are multiplexed and 
recorded on the DVD. 

Furthermore, the coded data recorded on the DVD are divided 



the coded data 



into plural pieces of data corresponding to second data units 
each including plural pieces of the first data units, and the 
coded data are managed in the second data units. The coded data 
corresponding to the second data units are referred to as video 
objects (VOB) . 

For example, the coded data corresponding to one program is 
composed of at least one VOB. In the video standard relating to 
DVDROM; a group comprising at least one VOB is called a video 
object set (VOBS), and it is recorded on the DVD as one title. 

Furthermore, on the DVD, together with 

corresponding to each title (program) , the following information 

is recorded as information for managing the title (program) : 

information indicating the position in the recording area of the 

DVD where the coded data corresponding to this title is recorded 

I 

(recording position information), video attribute information 

corresponding to the coded data, and audio attribute information 

corresponding to the coded data. Each information is recorded in 

VOB units, as mentioned above. 

The recording position information is various kinds of 

address information in the recording area of the DVD, for example, 

a header address and an end address of the area where the coded 

data of the VOBS corresponding to the title is recorded, or an 

I 

address indicating the search point which has previously set by 
the user. 

The video attribute information relates to the compressive 



coding mode, TV system, aspect ratio, display mode, etc. 

There are two types of compressive coding modes for DVD: a 
mode based on the MPEG-1 coding, and a mode based on the MPEG-2 
coding. The compressive coding mode information indicates that 
the coded data of each VOB corresponds to either the former mode 

or the latter mode. 

There are two types of TV systems: a system corresponding to 
the NTSC system (nuirJoer of lines: 525, frame frequency: 59.97Hz), 
and a system corresponding to the PAL system (number of lines: 
625, frame frequency: 50Hz) . The TV system information indicates 
that the coded data of each VOB corresponds to either the former 
system or the latter system. 

The aspect ratio is the ratio of the im< 
horizontal direction to the image size in the vertical direction, 
and two ratios, 4:3 and 16:9, are practically adopted. The 
aspect ratio information indicates that the coded data of each 
VOB corresponds to either 4:3 or 16:9. 

Further, the display mode is a method of image display based 
on the video signal obtained from the coded data. For example, 
it is the pan & scan display mode or the letter box display mode. 
The display mode information indicates a display mode by which 
the video signal obtained from the coded data of each VOB is to 
be displayed. 

In the pan & scan display mode, a wide image having an 
aspect ratio of 16:9 is displayed on a standard screen having an 



age size in the 



frame, and the 



aspect ratio of 4:3, by removing left and right sides of the wide 
image. In the letter box display mode, a wide image having an 
aspect ratio of 16:9 is displayed on a standard screen having an 
aspect ratio of 4:3, by adding regions of a predetermined color 
to top and bottom sides of the wide image. 

Meanwhile, there is the MPEG coding as an international 
standard of a compressive coding method for a video signal 
(hereinafter also referred to as image data) . In the MPEG coding, 
the process of coding the image data is adaprively switched 
between the intra-frame coding in which the image data is coded 
using the correlation of pixel values in one 
inter-frame coding in which the image data is coded using the 
correlation of pixel values between frames. In the MPEG coding, 
the coded data corresponding to continuous plural frames are 
regarded as one unit, and the image comprising the continuous 
plural frames is called a group of pictures (GOP) . 

To be specific, in the MPEG coding, the image data of at 
least one frame among the plural frames constituting the GOP is 
subjected to the intra-frame coding while the image data of the 
remaining frames are subjected to the inter- frame coding. 

There are two types of inter-frame coding: forward direction 
inter-frame predictive coding, and bi-directional inter-frame 
predictive coding. A frame to be subjected to the forward inter- 
frame predictive coding is called a P frame, ;and a frame to be 
subjected to the bi-directional inter-frame predictive coding is 




called a B frame. The image data of the P frame is subjected to 
the predictive coding with reference to the jlmage data of a frame 
(reference frame) positioned before the P frame. The image data 
of the B frame is subjected to the predictive coding with 
reference to the image data of two frames (reference frames) 
which are positioned close to and before and after the B frame- 
Usually/ when coding a P frame, an I frame close to the P frame 
is used as a reference frame. When coding a B frame, an I frame 
and a P frame (or two P frames) which are clLse to the B frame 
are used as reference frames. 

Figure 17 is a diagram for explaining an example of the 
structure of the GOP, wherein continuous plural frames F{k-5)"^ 
F(k+12) are associated with coded data D(k-5) -^0(^+12) 
corresponding to the respective frames. In figure 17, k is an 
arbitrary integer. 

One GOP is composed of twelve frames from the B frame F(k-2) 

to the P frame F(k+9) . For example, the P frame F(k+3) is 

I 

subjected to the inter-frame predictive coding with reference to 
the I frame F(k) . Further, the P frame F(k+6) is subjected to 
the inter-frame predictive coding with reference to the P frame 
F(k+3), Further, the B frames F(k+1) and F(k+2) are subjected to 
the inter-frame predictive coding with reference to the I frame 
F(k) and the P frame F(k-f3) . 

The coded data corresponding to the respective frames, which 
are obtained in the above-described coding process, are subjected 



to the process of changing the arrangement of the coded data from 
the arrangement according to the order of displaying the images 
of the respective frames to the arrangement according to the 
order of decoding the respective frames, thereby reducing the 
capacity of a memory used for decoding (rearrangement process) . 
To be specific, as shown in figure 17, in th| arrangement 
obtained by subjecting the coded data corresponding to the GOP to 
the above-mentioned rearrangement process, the coded data D(k) of 
the I frame F(k) is positioned at the head of the GOP, followed 
by the coded data D(k-2) of the B frame F(k-2), the coded data 
D(k-l) of the B frame F(k-l), and the coded data D(k+3) of the P 
frame F(k+3) . 

Then, the coded data corresponding to the GOP is recorded on 
a recording medium or transmitted through a transmission medium, 
according to the order after the rearrangement process. 

By the way, header information of a video stream (coded data 
obtained by coding a video signal) based on the MPEG standard 
includes, as video resolution information, information relating 
to the horizontal and vertical image sizes, frame frequency, and 
aspect ratio. Further, the header information includes 
information for recognizing that the video stream corresponds to 
either an interlace signal or a progressive sjignal. 

i 

In the standard relating to DVD, coded data which 
corresponds to at least one GOP and is equivalent to a display 
time longer than 0.4 sec. and shorter than 1.0 sec. is defined as 
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a video object unit (VOBU) (third data unit), and a VOB is 
composed of a plurality of VOBU. 

Each VOBU includes a plurality of packs (first data units), 
and the head position of the VOBU matches the head position of 
the packs. Further, at the head of the VOBU, a pack called a 
navigation pack, including information such as playback control 
information (PCI) and data search information (DSI), is placed. 
In the field of television broadcasting, OS (Communication 
O Satellite) broadcasting takes the lead in digitization, and 
ffl digital broadcasting of a high-vision TV signal will be started 
£ subsequent to digital broadcasting of a standard TV signal. 
m Accordingly, it is supposed that a standard TV signal and a high- 

vision TV signal will coexist in one broadcast sequence, or an 
% interlace signal and a progressive signal will coexist in one 

broadcast sequence. In this case, the video resolutions of the 
y TV signals which are broadcast in the same broadcast sequence, 
will change at a change of program. 

In such digital TV broadcasting, a video stream and an audio 
stream are multiplexed according to the MPEG standard to be 
transmitted as a transport stream. 

On the other hand, when recording the video stream and the 
audio stream on a DVD, the transport stream including the video 
stream and the audio stream is converted to a program stream to 
make the DVD have trick play functions, and this program stream 
is recorded on the DVD. Accordingly, when the audio video stream 
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obtained from the received digital TV broadcast signal is 
recorded on the DVD, the audio video stream must be converted 
from the transport stream to the program stream (TS/PS 
conversion) , and techniques relating to such stream conversion 
have already been developed. For example, Japanese Published 
Patent Application No. Hei . 11-45512 (HITACHI) discloses a 
technique of TS/PS conversion, i.e., a technique for converting a 
transport stream to a program stream, 

1 

Hereinafter, a description will be given of the standard for 
recording the program stream on a recording medium such as an 
optical disk. j 

Figure 18 is a diagram for explaining the format of recorded 
data 10 based on the recording standard, and illustrates the 

specific contents of video attribute information (V ATR) lOdl. 

The recorded data 10 is data recorded on a recording medium 
by a recorder based on the above-described recording standard, 

i 

and this recorded data 10 is composed of a video manager (VMG) 

10a, and three video objects: a video object {VOB(l)) lOal, a 

video object (V0B(2)) 10a2, and a video object {V0B(3)) 10a3. 

Each of the VOB(l) lOal ^ V0B(3) 10a3 includes an audio video 
stream, and the VMG 10a includes management information for each 

VOB. 

The recorded data 10 corresponds to one. TV broadcast program 
Further, the recorded data 10 is divided intoi three VOBs 
according to the above-mentioned recording standard because the 



user performed two times of pause operations while recording the 
audio video stream of this program. That is, the boundary 
between the VOB(l) lOal and the V0B(2) 10a2 corresponds to the 
first pause position, and the boundary between the V0B{2) 10a2 
and the V0B(3) 10a3 corresponds to the second pause position. In 
other words, in the recording process based on the DVD recording 
standard, when recording of the audio video stream is paused, the 
streams before and after the pause position are recorded as 
different VOBs on the recording medium. 

As described above, the VMG 10a is management inform.ation 
for each VOB recorded, and the VMG 10a is composed of video 
manager information (VMGI) lObl and an audio video file 
information table (AVFIT) 10b2 . The VMGI lObl includes, as 
search information, information relating to the time when each 
VOB was recorded on the recording medium (recording time), and 
the address of the recording area in the recording medium 
corresponding to each VOB (recording address) . 

Further, the AVFIT 10b2 includes audio video file table 
information (AVFITI) 10c, and plural pieces of video object 

stream information (VOB STI) as many as the h'omber of the 

recorded VOBs, i.e., V0B_STI(1) IGcl, VOB_STI (2) 10c2, and VOB_ 
STI (3) 10c3. The AVFITI 10c includes informJtion about the 

number of the recorded VOBs, and the like. Each of the VOB_STI 
10cl'^10c3 includes the attribute information of the 
corresponding VOB. For example, the VOB STI.(l) lOcl is composed 
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of video attribute information (V ATR) lOdl and audio attribute 

information (A_ATR) 10d2, 

Hereinafter, the video attribute information (V ATR) lOdl 

will be described in detail. 

The V ATR lOdl includes compression mode information lOel, 

horizontal video resolution (K video resolution) information 

-10e2, vertical video resolution (V video resolution) information 

10e3, frame frequency information 10e4, TV system information 
lOeS, and aspect ratio information 10e6. 

The compression mode information lOel is information for 
recognizing that the video stream of each VOB is based on either 
the MPEG-1 coding or the iMPEG-2 coding. 

In the horizontal video resolution information 10e2, 
information for identifying the frame size in the horizontal 
direction corresponding to each VOB is described. To be specific 
as the number of pixels in the horizontal direction, any of the 
following values is described: 352, 480, 544, 704, 720, 1440, 
1920, 

In the vertical video resolution information 10e3, 

1 

information for identifying the frame size in' the vertical 
direction corresponding to each VOB is described. To be specific 
as the number of scanning lines, any of the following values is 
described: 240, 480, 576, 720, 1080. 

The frame frequency information 10e4 is information for 
identifying the frame frequency corresponding to each VOB. For 
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example, it shows any of the following frequencies: 24Hz, 29.97Hz 
30Hz, 25H2, 50Hz, 60Hz. 

The TV system information lOeS is information for 
identifying that the video signal corresponding to each VOB is 
either an interlace signal or a progressive signal. 

The aspect ratio information lOeS is idformation for 
identifying the aspect ratio of the video signal corresponding to 
each VOB. For example, it shows the value of the aspect ratio 
(4:3 or 16:9), or the type of the letter box. 

While the V ATR lOdl shown in figure 18 includes the 

I compression mode information lOel, the horizontal video 
; resolution information 10e2, the vertical video resolution 

information 10e3, the frame frequency information 10e4, the TV 
system information 10e5, and the aspect ratio information 10e6, 

the V ATR lOdl may include caption data information (Line21 

switch) 10e7 in addition to the information 10el^l0e6 as shown 

j 

in figure 19. The caption data information 10e7 is information 
for identifying whether each of the video signals in the first 
and second fields includes Line21 data or not. The Line21 data 
is closed caption data which is superposed on a portion of the 
video signal corresponding to the 21st line. 

Next, the audio attribute information (A ATR) 10d2 will be 

described in detail. 



Figure 20 is a diagram for explaining tY 



e format of the 



above-described recorded data, and illustrates the specific 
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contents of the audio attribute information (A ATR) 10d2. 

The A_ATR 10d2 includes, as information for identifying the 
attribute of the audio signal corresponding to each VOB, coding 
mode information lOfl, quantization information 10f2, dynamic 
range control (DRC) information 10f3, sampling frequency (fs) 
information 10f4, number-of-audio-channels information lOfS, and 

I 

audio bit rate information 10f6. 

The coding mode information lOfl is information for 
identifying the type of the audio stream corresponding to each 
VOB. For example, it shows that the audio stream corresponds to 
any of the following modes: Dolby AC3, MPEG-1, MPEG-2, and Linear 
PCM (Pulse Code Modulation) . 

The quantization information 10f2 is information for 
identifying the number of quantized bits (16 bits, 20 bits, 24 
bits, etc.) in the case where the audio stream corresponding to 
each VOB is subjected to Linear PCM. 

The dynamic range control information 10f3 is information 
for identifying whether or not the audio stream corresponding to 

each VOB includes dynamic range control data in the MPEG-1 or 

j 

MPEG-2 coding. 

The sampling frequency information 10f4 is information for 
identifying the sampling frequency (48kHz, 96|kHz, etc.) of the 
audio stream corresponding to each VOB. 

The number-of-audio-channels information lOfS is information 
for identifying the number of channels (lch(mono), 2ch (stereo). 
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2ch(daal mono), 3ch, 4ch, 5ch, 6ch, 7ch, 8ch; etc.) of the played 
audio signal obtained from the audio stream corresponding to each 
VOB. 

The audio bit rate information 10f6 is information for 
identifying the bit rate (64kbps, 89k:bps, 112kbps, 128kbps, 
160kbps, 192kbps, 224kbp3, 256kbps, 320kbps, 384kbps, 448kbps, 
768kbps, 1535kbps, etc.) of the audio stream corresponding to 
each VOB. 

: It is possible to recognize the recording time of the audio 

I video stream corresponding to each VOB, the recording address 
thereof, and the attribute information of each VOB, by reading 
the VMG 10a from the data 10 recorded on the recording medium 
(optical disk) . 

Next, the structure of the VOB in the recorded data 10 will 
be described with reference to figures 21(a), 21(b), 22(a) and 
22(b). Figures 21(a) and 22(a) show the detailed structure of 
the VOB(l) lOal in the recorded data 10. 

I 

The VOB(l) lOal is composed of plural video object units, 

i.e., V0BU{1) lOgl, V0BU(2) 10g2, V0BU(3) log's, V0BU(4) 10g4, 

i 

VOBU(n) lOgn. 

One VOBU includes an audio video stream which corresponds to 

at least one GOP and is equivalent to a display time of 0.4^1.0 
sec. For example, the VOBU(l) lOgl is composed of plural video 

packs (V_PCK) lOh(l), 10h(2), 10h(3), l6h(r), and plural 

audio packs (A_PCK) lOi(l), 10i(2), lOi(s). Each of the 
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video packets and audio packets has a predetermined data size, 
and the data size is 2048 bytes in this case. 

Figure 21(b) shows the video packs lOh(l) ^10h(8) associated 
with the streams of the respective frames constituting the GOP. 

The VOBU(l) lOgl includes a video stream corresponding to 
one GOP. To be specific, the video stream included in the 
VOBU(l) lOgl is composed of I frame coded data Dvl, B frame coded 
data Dv2 and Dv3, P frame coded data Dv4, B frame coded data Dv5 
p and Dv6, P frame coded data Dv7, B frame coded data Dv8 and Dv9, 
01 and padding data Dpud. 

^ Since each VOBU is composed of the video packs and audio 

.2 packs each having 2048 bytes, the data size of the VOBU should be 
'"^ an integer multiple of 2048 bytes. So, the padding data Dpud is 
y added to the video stream corresponding to one GOP to make the 
y data size of the video stream included in the VOBU equal to an 
□ integer multiple of 2048 bytes. 

Figure 22(b) shows the audio packs lOi (1) --^lOi (4 ) 
constituting the VOBU(l) lOgl, associated with the streams of the 

respective audio frames. 

The VOBU(l) lOgl includes an audio stream corresponding to 
one GOP. To be specific, the audio stream included in the 
VOBU(l) lOgl is composed of coded data of the' audio frames Dal 
Da8 and the padding data Dpudl~Dpud4 corresponding to the 

respective audio packs (A_PCK) lOi (1) -^lOi (4) . That is, the A 

PCK lOi(l) includes the coded data of the audio frames Dal and 



• 
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Da2 and the padding data Dpudl, the A PCK 10i{2) includes the 

coded data of the audio frames Da3 and Da4 and the padding data 

Dpud2, the A PCK 10i{3) includes the coded data of the audio 

frames Da5 and Da6 and the padding data Dpud3, and the A PCK 

10i(4) includes the coded data of the audio frames Da7 and Da8 
and the padding data Dpud4 . 

As described above, the audio stream of one A PCK lOi(s) is 

composed of the coded data of two audio frames and the padding 

3 data to make the data size of the audio stream included in the 

u 

H VOBU equal to an integer multiple of 2048 bytes. 

d While in figures 21(b) and 22(b) only the structures of the 

Q VOB lOal and VOBU(l) lOgl are described, the VOB 10a2 and VOB 

lOaS and the VOBU (2) 10g2 ~ VOBU(n) lOgn also have the same 
i structures as those of the VOB lOal and VOBU(l) lOgl, 

i ; • 
— I 

f respectively. 

£ As described above, since the VOBU has the data structure 

which is divided into data units each having a predetermined data 
size (2048 bytes), address management for the VOBU is simplified, 
and access to data in VOBU units on the recording medium is 
facilitated . 

In the conventional recording apparatus^, however, the audio 
video stream is usually recorded as one VOB, and management of 
its attribute is performed for the whole stream in the lump. 
This results in various drawbacks as follows. 

When the conventional recording apparatus records the audio 
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video stream, the stream inputted to the recording apparatus from 
when the recording is started to when the recording is ended, is 
recorded as one VOB on the recording medium. However, when the 
recording operation is paused, the stream inputted before the 
pause and the stream inputted after the pause are recorded as 
different VOBs on the recording medium. Further, there are other 
causes by which the audio video stream is recorded as plural VOBs. 

In other words, in the conventional recording apparatus, the 
audio video stream corresponding to one program is usually 
recorded as one VOB on the recording medium. When the recording 
of the stream is paused to prevent a portion of the stream 
corresponding to a CM (commercial) or the like from being 
recorded, the audio video stream corresponding to one program is 
recorded as different VOBs. 

By the way, since a digital broadcast signal is usually 
inputted to the recording apparatus as an MPEG stream {audio 
video stream corresponding to the MPEG standard) , when the 
digital broadcast signal is received and recorded, the video 
attribute (e.g., video resolution) changes from scene to scene 
during the recording, in contract with recording of an analog 
broadcast signal. For example, the resolution in the horizontal 
direction changes from 720 pixels to 312 pixels. 

Further, when a standard TV broadcast program and a high- 
vision TV broadcast program are recorded continuously, the aspect 
ratio, which is an attribute of the recorded data corresponding 
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stream results, in 



to each program, changes from 4:3 to 16:9 at the point where the 

program changes. 

In this case, two audio video streams having different 

j 

attributes are recorded as one VOB, whereby management of the 
video attribute of the stream recorded on the recording medium 
becomes difficult . 

Further, in the process of playing the audio video stream 
recorded on the recording medium, since the video stream (coded 
data) is decoded with the video resolution as a parameter, 
management of the video resolution as the video attribute is 
insufficient. If the change of the video resolution is not 
posted to the decoder, decoding of the video 
failure . 

Furthermore, since the recording position of the audio video 
stream is managed by the address corresponding to each VOBU which 
is a constituent of the VOB, direct access cannot be made to the 
position where the video resolution changes, in the stream 
included in the VOBU. Therefore, random access to the beginning 
of the program, based on the change of the video resolution, 
cannot be performed at high speed. 

Moreover, although the coded data included in the VOBU is 
divided into data units (packs) each having a predetermined data 
size (2048 bytes) and each pack is managed by the address 
indicating the recording position of its head data, the position 
corresponding to the video resolution change point in the stream 
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is not always equal to the head position of the pack as the 
access unit and, therefore, the video resolu":ion change position 
in the stream cannot accessed by using the address indicating the 
recording position of the pack. 

Furthermore, when the video signal is coded by the MPEG-2 
coding, the coding mode for each frame is decided based on a 

predetermined rule, and coding is performed so that a GOP 

1 

comprising at least one I frame, plural P frames, and plural B 

frames is constituted according to the decided coding mode. 

Therefore, when the video resolution changes, the video 

resolution may vary between the frames constituting one GOP, and 

a stream adapted to the iyiPEG-2 standard cannot be generated. 

Furthermore, in the MPEG coding, the inter-frame predictive 

coding is carried out, that is, the video signal of the target 

frame to be processed is coded with reference to the video signal 

of the reference frame which has already been coded. Therefore, 

I 

when the video resolution changes, the video resolution varies 
between the target frame and the reference frame, and the inter- 
frame predictive coding results in failure. 

Also when recording the coded data obtained by coding the TV 
signal whose aspect ratio changes, the following drawbacks will 
occur like in the above-described case where ithe video resolution 
changes . 

That is, when the video aspect ratio changes, management of 
the video attribute of the recorded audio video stream (coded 
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data) becomes difficult. Further, in the playback process, 
decoding of the coded data results in failure due to the change 
of the video aspect ratio. Moreover, quick access cannot be made 
to the position where the video aspect ratio changes, in the 
video stream. 

Moreover, in the MPEG coding, when the video aspect ratio 
changes, a stream adapted to the MPEG-2 standard cannot be 
generated, or the inter-frame predictive coding results in 
failure, as in the above-described case where the video 
resolution changes. 

with respect to a video signal having plural video 
attributes not only the video resolution and. the video aspect 
ratio but also the coding mode and the like, access cannot be 
made to the position where the video attribute changes, in the 
recorded video stream. 

Further, with respect to an audio video signal including not 
only a video signal but also an audio signal 'appended to the 
video signal, access cannot be made to the position where the 
audio attribute {coding mode, number of channels, bit rate, etc.) 
of the audio signal changes, in the recorded idata corresponding 
to this audio video signal. 
sniynviARY of the invention 

The present invention is made to solve the above-described 
problems, and it is an object of the present invention to provide 
a recording apparatus which can record coded data corresponding 
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to a TV signal in which at least one of the video attribute 

I 

(coding mode, video resolution, video aspect' ratio, or the like) 
and the audio attribute (coding mode, number of channels, bit 
rate, or the like) changes, so as to enable quick access to the 
position where the attribute changes. 

It is another object of the present invention to provide a 
recording apparatus which can record coded data corresponding to 
a TV signal in which at least one of the video attribute and the 
audio attribute changes, on a recording medium, while managing 
the coded data so as to enable satisfactory decoding of the coded 
data . 

It is still another object of the present invention to 
provide a coding apparatus which can code a video signal in which 
the video attribute (coding mode, video resolution, video aspect 
ratio, or the like) changes, according to a predetermined coding 
method such as MPEG. 

Other objects and advantages of the invention will become 
apparent from the detailed description that follows. The 
detailed description and specific embodiments, described are 
provided only for illustration since various additions and 
modifications within the scope of the invention will be apparent 
to those of skill in the art from the detailed description. 

According to a first aspect of the present invention, there 
is provided a recording apparatus for recording, on a recording 
medium, an audio video stream which is obtained by coding an 
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audio video signal including an audio signal and a video signal. 
This apparatus comprises an attribute detector for detecting an 
attribute relating to at least one of the video signal and the 
audio signal on the basis of the audio video stream, and 
outputting attribute data indicating the attribute; an 
information generator for detecting a recording position in the 
audio video stream recorded on the recording medium, which 
receding position corresponds to a point where the attribute 
changes, or a recording time of the audio video stream based on a 
reference time, which recording time corresponds to the attribute 
change point, and outputting attribute change information 
indicating the recording position or the recording time; and a 
recorder for recording the attribute data and the attribute 
change information on the recording medium. Therefore, when 
playing the audio video stream recorded on the recording medium, 
a portion of the audio video stream where the video attribute or 
the audio attribute changes can be recognized, whereby the 
portion of the stream where the attribute change occurs can be 
accessed quickly. 

According to a second aspect of the present invention, in 
the recording apparatus of the first aspect, the attribute 
detector detects a video attribute relating to the video signal 
and an audio attribute relating to the audio signal, and outputs 
attribute data indicating each attribute; and the recorder 
records the attribute data indicating the video attribute and the 
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attribute data indicating the audio attribute in predetermined 
recording areas of the recording mediuiri/ respectively. Therefore, 
when playing the audio video stream, a portion of the stream 
where either the video attribute or the audio attribute changes 



can be accessed quickly. 

According to a third aspect of the pres 



ant invention, in the 



recording apparatus of the first aspect, the attribute detector 
detects the video resolution of the video signal as an attribute 
relating to the video signal, and outputs video resolution data 
indicating the video resolution; on the basis of the video 
resolution data, the information generator detects a recording 
position in the stream recorded on the recording mediuna, which 
recording position corresponds to a point where the video 
resolution changes, or a recording time of the stream based on a 
reference time, which recording time corresponds to the video 
resolution change point, and outputs attribute change information 
indicating the recording position or the recording time; and the 
recorder records the video resolution data and the resolution 



change information on the recording medium, 
playing the audio video stream, a portion of 
video resolution changes can be accessed quic 



Therefore, when 



the stream where the 



kly. 



According to a fourth aspect of the present invention, in 
the recording apparatus of the first aspect, the attribute 
detector detects the aspect ratio of the video signal as an 



attribute relating to the video signal, and outputs aspect ratio 
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data indicating the aspect ratio; on the basis of the aspect 
ratio data, the information generator detects a recording 
position in the stream recorded on the recording medium, which 
recording position corresponds to a point where the aspect ratio 
changes, or a recording time of the stream based on a reference 
time, which recording time corresponds to the aspect ratio change 
point, and outputs aspect ratio change information indicating the 
recording position or the recording time; and the recorder 

I 
I 

records the aspect ratio data and the aspect ratio change 
information on the recording medium. Therefore, when playing the 
audio video stream, a portion of the stream where the aspect 
ratio changes can be accessed quickly. 

According to a fifth aspect of the present invention, there 
is provided a recording apparatus for recording, on a recording 



ed by coding an 
and a video signal, 
performing packing 



medium, an audio video stream which is obtair 
audio video signal including an audio signal 
This apparatus comprises: a packing unit for 
to divide the audio video stream into plural 'streams 
corresponding to packs as data units each having a predetermined 
size, and outpucting the audio video stream corresponding to each 
pack as pack data; a recorder for recording each pack data on the 
recording m.edium, as an access unit to the recording medium; and 
an attribute detector for detecting an attribute relating to at 
least one of the video signal and the audio signal, and 
outputting attribute data indicating the attribute. The packing 
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unit performs the packing such that a position in the audio video 
stream, where the attribute changes, is positioned at the head of 
the pack. Therefore, a portion where the video attribute or the 
audio attribute changes, of the audio video stream whose 
recording addresses are managed in pack units, can be recognized. 
When playing the audio video stream, the potion where the 
attribute change occurs can be accessed quiccly. 

Accordi.ng to a sixth aspect of the present invention, in the 
recording apparatus of the fifth aspect, the attribute detector 
detects a video attribute relating to the video signal and an 
audio attribute relating to the audio signal on the basis of the 
audio video stream, and outputs video attribute data indicating 
the video attribute and audio attribute data; indicating the audio 
attribute; and the recorder records the video attribute data and 
the audio attribute data in predetermined areas of the recording 
medium, respectively. Therefore, when playing the audio video 
stream recorded on the recording medium, the video attribute and 
the audio attribute corresponding to this stream can be 

identified. 

According to a seventh aspect of the prii 
recording apparatus of the fifth aspect further comprises an 
information generator for detecting a recording position in the 
audio video stream recorded on the recording medium, which 
recording position corresponds to a point where at least one of 
the audio attribute and the video attribute changes, or a 



esent invention, the 
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recording time of the audio video stream based on a reference 
time, which recording time corresponds to the attribute change 
point, and outputting attribute change information indicating the 
recording position or the recording time; and the recorder 
records the attribute change information on the recording medium. 
Therefore, when playing the audio video stream recorded on the 
recording medium, a portion of the stream where the video 
attribute or the audio attribute changes can be accessed quickly 
by reading the recording position or the recording time 
corresponding to the attribute change point. 

According to an eighth aspect of the present invention, in 



the recording apparatus of the fifth aspect, 



the attribute 



detector detects the video resolution of the video signal as an 
attribute relating to the video signal, and outputs video 
resolution data indicating the resolution; and the packing unit 
performs the packing, on the basis of the video resolution data, 
such that a position in the video stream, whf^re the video 
resolution changes, is positioned at the head of the pack. 
Therefore, a portion where the video resolution changes, of the 
audio video stream whose recording addresses are managed in pack 



un 



its, can be recognized. When playing the audio video stream, 



the portion of the stream where the video resolution changes can 
be accessed quickly. 

According to a ninth aspect of the present invention, in the 
recording apparatus of the fifth aspect, the attribute detector 
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detects the aspect ratio of the video signal' as an attribute 
relating to the video signal, and outputs aspect ratio data 



indicating the aspect ratio; and the packing 



unit performs the 



packing, on the basis of the aspect ratio data, such that a 

i 

position in the video stream, where the aspect ratio changes, is 
positioned at the head of the pack. Therefore, a portion where 
the aspect ratio changes, of the audio video stream whose 
recording addresses are managed in pack units, can be recognized. 

o When playing the audio video stream, the portion where the aspect 

m ratio change occurs can be accessed quickly. 

^ According to a tenth aspect of the present invention, there 

^ is provided a recording apparatus for recording, on a recording 



me 



dium, an audio video stream which is obtained by coding an 



audio video signal including an audio signal and a video signal. 

This apparatus comprises a video object composer for dividing the 

i 

audio video stream into plural streams corresponding to 
management units for managing the audio video stream, and 
outputting the stream corresponding to each ;nanagement unit as 
video object data; a recorder for recording management 
information for managing each video object data on the recording 



me 



dium; and an attribute detector for detecting an attribute 



relating to at least one of the video signal and the audio signal 
on the basis of the audio video stream, and outputting attribute 
data indicating the attribute. When the attribute changes, the 
video object composer divides the audio video stream, on the 
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basis of the attribute data, such that a portion of the audio 
video stream before the attribute change point and a portion of 
the audio video stream after the attribute change point are 
output as different video object data. Therefore, when playing 



the audio video stream recorded on the recorjiing medium, decoding 
of each video object data is performed on the basis of the video 
attribute or audio attribute which is managed in video object 



units . 



According to an eleventh aspect of the 



present invention, in 



the recording apparatus of the tenth aspect, the management 
information includes information relating to the recording 
position of each video object data on the recording medium, or 
the recording time of each video object data based on a reference 
time. Therefore, the audio video stream recorded on the 
recording medium can be managed in video object units. 

According to a twelfth aspect of the present invention, in 



the recording apparatus of the tenth aspect, 



the attribute 



detector detects a video attribute relating to the video signal 
and an audio attribute relating to the audio. signal on the basis 
of the audio, video stream, and outputs video -.attribute data 
indicating the video attribute and audio attribute data 
indicating the audio attribute; and the management information 
includes video attribute information indicating the video 
attribute and audio attribute information indicating the audio 
attribute. Therefore, the attribute of the audio video stream 
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recorded on the recording medium can be managed in video object 
units . 

According to a thirteenth aspect of the present invention, 
in the recording apparatus of the tenth aspecjit, the attribute 
detector detects the video resolution of the jvideo signal as an 
attribute relating to the video signal, and outputs video 
resolution data indicating the resolution; and when the video 
resolution changes, the video object composer divides the video 
stream, on the basis of the video resolution data, such that a 
portion of the video stream before the video resolution change 
point and a portion of the video stream after the video 
resolution change point are output as different video object data. 
Therefore, the video attribute can be unified with respect to one 
video object data. Thereby, when playing the audio video stream 
recorded on the recording medium, decoding of each video object 
data can be performed on the basis of the video resolution which 
is managed in video object units. 

According to a fourteenth aspect of the present invention, 
in the recording apparatus of the tenth aspect, the attribute 
detector detects the aspect ratio of the video signal as an 
attribute relating to the video signal, and outputs aspect ratio 
data indicating the aspect ratio; and when the aspect ration 
changes, the video object composer divides the video stream, on 
the basis of the aspect ratio data, such that a portion of the 
video stream before the aspect ratio change point and a portion 



29 



of the video stream after the aspect ratio change point are 

output as different video object data. Therefore, the aspect 

ratio can be unified with respect to one video object data. 

I 

Thereby, when playing the audio video stream . recorded on the 

recording medium, decoding of each video object data can be 

I 

performed on the basis of the aspect ratio which is managed in 
video object units. 

According to a fifteenth aspect of the present invention, a 
coding apparatus for coding a video signal comprises a video 
encoder for subjecting the video signal to intra-frame coding or 
inter-frame coding such that a group of frames including at least 
one frame subjected to the intra-frame coding is generated, and a 
video stream corresponding to the frame group is output as a 
stream unit that can be accessed randomly; and a video attribute 
detector for detecting a video attribute of the video signal, and 

outputting video attribute data indicating the video attribute. 

I 

The video encoder forms the frame group such that a specific 
frame, whose video attribute is different from that of a frame 
positioned just before it, is stored as a heed frame in the frame 
group. Therefore, when playing the video stream recorded on the 
recording medium with each frame group as an access unit, a 
portion of the video stream where the video attribute changes can 
be accessed quickly. 

According to a sixteenth aspect of the present invention, 
Lhe coding apparatus of the fifteenth aspect further comprises an 
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audio attribute detector for detecting an audio attribute of an 
audio signal appended to the video signal, ai^d outputting audio 
attribute data indicating the audio attribute; and the video 
encoder forms the frame group such that a sp^jcific frame, whose 
video or audio attribute is different from that of a frame 
positioned just before it, is stored as a head frame in the frame 
group. Therefore, when playing the video stream recorded on the 



recording medium v;ith each frame group as an 
portion of the video stream corresponding to 
point can be accessed quickly. 



access unit, a 



the attribute change 



J According to a seventeenth aspect of the present invention, 

the coding apparatus of the sixteenth aspect further comprises a 

" packing unit for performing packing to divide the video stream, 
into plural streams corresponding to packs as data units each 

H having a predetermined size, and outputting the stream 

0 corresponding to each pack as pack data; and the packing unit 
performs the packing such that a position in the video stream, 
where the video or audio attribute changes, is positioned at the 
head of the pack. Therefore, when playing the video stream 
recorded on the recording medium while managing the addresses in 
pack units, a portion of the stream corresponding to the 
attribute change point can be accessed quickly. 

According to an eighteenth aspect of the present invention, 
in the coding apparatus of the fifteenth aspect, the video 
encoder performs coding on each frame in a specific frame group 
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including the specific frame, without referring to the video 
signal corresponding to frames in a frame group which has been 
coded previously to the specific frame group. Therefore, the 
video stream corresponding to the specific frame group can be 
played randomly. That is, coding of the specific frame group is 
performed without referring to the video sigrjal of an already 
processed frame group whose video attribute ^video resolution) is 
different from that of the specific frajne group. Therefore, when 
a target frame to be coded is subjected to inter-frame prediction 
coding, only a frame whose video attribute (video resolution) is 
identical to that of the target frame is used as a reference 
frame, whereby decoding of the video stream is facilitated. 
Further, when the target frame is subjected to inter-frame " 
prediction coding, only a frame whose aspect ratio is identical 
to that of the target frame is used as a reference frame, whereby 
the target frame is coded efficiently. 

According to a nineteenth aspect of the present invention, 
in the coding apparatus of the fifteenth aspect, the video 
attribute detector detects the video resolution of the video 
signal as a video attribute on the basis of the video signal, and 
outputs video resolution data indicating the video resolution; 
and the video encoder forms the frame group, 'on the basis of the 
video resolution data, such that a specific frame, whose video 
resolution is different from that of a frame positioned just 
before it, is stored as a head frame in the frame group. 
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Therefore, when playing the video stream recorded on the 
recording medium with each frame group as an access unit, a 
portion of the video stream where the video resolution changes 
can be accessed quickly. 



present invention, 

ses a 



According to a twentieth aspect of the 
the coding apparatus of the nineteenth aspecj further compri 
packing unit for performing packing to divide the video stream 
into plural streams corresponding to packs as data units each 
having a predetermined size, and outputting the stream 
corresponding to each pack as pack data; and the packing unit 
performs the packing such that a position in the video stream, 
where the video resolution changes, is positioned at the head of 
the pack. Therefore, when playing the video stream recorded on 
the recording medium while managing the addresses in pack units, 
a portion of the stream corresponding to the resolution change 
point can be accessed quickly. 

According to a twenty-first aspect of the present invention, 
in the coding apparatus of the fifteenth aspect, the attribute 
detector detects the aspect ratio of the video signal as the 
video attribute on the basis of the video signal, and outputs 
aspect ratio data indicating the aspect ratio; and the video 
encoder forms the frame group, on the basis of the aspect ratio 
data, such that a specific frame, whose aspect ratio is different 
from that of a frame positioned just before it, is stored as a 
head frame in the frame group. Therefore, when playing the video 
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stream recorded on the recording medium with each frame group as 
an access unit, a portion of the video streai^i where the aspect 
ratio changes can be accessed quickly. 

According to a twenty-second aspect of the present invention, 
the coding apparatus of the twenty-first aspect further comprises 
a packing unit for performing packing to divide the video stream 
into plural streams corresponding to packs as data units each 
having a predetermined size, and outputting the stream 
corresponding to each pack as pack data; and the packing unit 
performs the packing such that a position in the video stream, 
where the aspect ratio changes, is positioned at the head of the 
pack. Therefore, when playing the video stream recorded on the 
recording medium while managing the addresses in pack units, a 
oortion of the stream corresponding to the aspect ratio change 
point can be accessed quickly. 
BRIEF DESCRIPTION O F THE DRAWINGS 



ing a recording 
the present 



Figure 1 is a block diagram for explair, 
apparatus according to a first embodiment of 

invention. | 

Figure 2 is a block diagram for explaining a recording 
apparatus according to a second embodiment of the present 
invention . 

Figure 3 is a block diagram for explaining a recording 
apparatus according to a third embodiment of the present 
invention , 



Figure 4 is a block diagram for explaining a recording 
apparatus according to a fourth embodiment of the present 
invention. 

Figure 5 is a block diagram for explaining a recording 
apparatus according to a fifth embodiment of the present 
invention . 

Figure 6 is a block diagram for explaining a recording 
apparatus according to a sixth embodiment of jthe present 
invention . 

Figure 7 is a block diagram for explaining a recording 
apparatus according zo a seventh embodiment of the present 
invention . 

Figure 8 is a block diagram for explaining a recording 
apparatus according to an eighth embodiment of the present 
invention. I 

Figure 9 is a block diagram for explaining a recording 

apparatus according to a ninth embodiment of :the present 

I 

invention. 

Figure 10 is a block diagram for explaining a coding 
apparatus according to a tenth embodiment of .the present 
invention. 

Figure 11 is a block diagram for explaining a coding 
apparatus according to an eleventh embodiment of the present 
invention . 

Figure 12 is a block diagram for explaining a coding 
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apparatus according to a twelfth embodiment of the present 
invention. 

Figure 13 is a schematic diagram for explaining the 
operation of the coding apparatus according to the twelfth 
embodiment, illustrating plural frames constituting one GOP. 

Figure 14 is a block diagram for explaining a coding 
apparatus according to a thirteenth embodiment of the present 
invention . 

Figure 15 is a block diagram for explaining a coding 
apparatus according to a fourteenth embodiment of the present 
invention . 

Figure 16 is a block diagram for explaining a coding 
apparatus according to a fifteenth embodiment of the present 
invention . 

Figure 17 is a diagram illustrating the structure of one GOP 
based on MPEG coding, and the structure of coded data 
corresponding to the GOP. 

Figure 18 is a diagram for explaining a recording format 
employed when recording an audio video stream on a recording 
medium, and illustrates video attribute information in detail. 

Figure 19 is a diagram for explaining another recording 
format employed when recording an audio video stream on a 
recording medium, and illustrates video attribute information in 
detail . 

Figure 20 is a diagram for explaining a recording format 
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employed when recording an audio video stream on a recording 
medium, and illustrates audio attribute information in detail. 

Figures 21(a) and 21(b) are diagrams illustrating a format 
of a video object (21(a)) employed when recording an audio video 
stream on a recording medium, and video packets (21(b)) 
constituting the video object. 

Figures 22(a) and 22(b) are diagrams illustrating a format 
of a video object (22(a)) employed when recording an audio video 
stream on a recording medium, and video packets (22(b)) 
constituting the video object. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[Embodiment 1] 

Figure 1 is a block diagram for explaining a recording 
apparatus 100a according to a first embodiment of the present 
invention. 

The recording apparatus 100a includes a broadcast receiver 
102 and a VOB composer 103. The broadcast receiver receives a 
digital broadcast signal Sbr, and outputs an audio video stream 
Sav. The VOB composer 103 converts the audio video stream Sav 
into recordable data according to a format of a video standard, 
and outputs VOB data Dvob. 

The broadcast receiver 102 has a TS/PS conversion function 
for converting a transmission format stream (transport stream) 
into a record format stream (program stream) , and the audio video 
stream Sav outputted from the broadcast receiver 102 is a program 
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Stream. Further, a packing unit (not shown) is provided between 
the broadcast receiver 102 and the VOB composer 103. The packing 
unit divides the audio video stream Sav into plural streams 
corresponding to first data units each having a predetermined 
size (2Kbyte) . The packing unit outputs data (PCK data) 
corresponding to each data unit (pack) to the VOB composer 103. 
Further, this packing unit outputs, as the PCK data, audio packs 

containing audio streams (A PCK) and video packets containing 

video streams (V_PCK) . Although the PCK data is fixed-length 
data of 2Kbyte, it may be variable-length data. In this case, 
the data size is written in the header of each pack. Further, as 
shown in figures 21(a)&(b) and 22(a)&(b), the VOB composer 103 
forms a third data unit (VOBU) comprising plural packs on the 
basis of the PCK data supplied from the packing unit, and further 
forms a second data unit (VOB) comprising plural VOBUs, and 
outputs the data corresponding to the VOB as the above-described 

VOB data Dvob. ' 

The recording apparatus 100a further includes a video 
attribute detector 107 and an audio attribute detector 109. The 
video attribute detector 107 receives the audio video stream Sav, 
detects a video attribute of the video stream included in the 
audio video stream Sav by analyzing header information of the 

video stream, and outputs data indicating the video attribute 

I 

(video attribute data Dva) . The audio attribute detector 109 
receives the audio video stream Sav, detects an audio attribute 
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of the audio stream included in the audio video stream Sav by 
analyzing header information of the audio stream, and outputs 
data indicating the audio attribute (audio attribute data Daa) . 

The video attribute is, for example, any of the coding mode 
(e.g., MPEG-1 coding or MPEG-2 coding), horizontal frame size, 
the vertical frame size, frame frequency, pixel sampling 
frequency, chrominance signal component format, aspect ratio, 
letter box, bit rate, scanning mode (interlacje or progressive), 
etc. The video attribute detector 107 detects at least one of 
these attributes. The audio attribute is, for example, any of 
the coding mode, number of channels, sampling frequency, number 
of quantized bits, dynamic range control, bit rate, etc. The 
audio attribute detector 109 detects at least one of these 
attributes . 

The recording apparatus 100a further includes a system - 
controller 111, an address information generator 108, and a VMG 
generator 110. The system controller ill generates write address 
information Iwa which indicates a position (write address) where 
data is to be written in the recording area of the recording 
medium 106. The address information generator 108 outputs 
specific address information Isa which indicc.tes the write 
address at the time when the attribute changes, on the basis of 
the video attribute data Dva, the audio attribute data Daa, and 
the address information Iwa. The VMG generator 110 generates VMG 
information Dvmg which is management information for each VOB, on 
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the basis of the video attribute data Dva, the audio attribute 
data Daa, and the specific address information Isa. When the 
video attribute or audio attribute of the audio video stream Sav 
changes, Lhe VMG generator 110 outputs the VMG information Dvmg 
including the specific address information Isa which indicates 
the write address at the time when the attribute change occurs. 

The recording apparatus 100a further includes a recording 
signal processor 110 and a recording head 105, The recording 
signal processor 110 subjects the VOB data Dvob from the VOB 
composer 103 and the VMG information Dvmg from the VMG generator 
110 to addition of error correcting code and recording modulation, 
and outputs a recording signal Sre corresponding to the VOB data. 
The recording head 105 writes the recording signal Sre on the 
D recording medium 106 such as an optical disk. 

f\ In figure 1, reference numeral 101 denotes an antenna for 

U receiving the digital broadcast signal, and the output from the 
antenna 101 is received by the broadcast receiver 102. 

Hereinafter, the operation of the recording apparatus 100a 

will be described. 

The broadcast signal Sbr from the antenna 101 is received by 
the broadcast receiver 102, wherein the broadcast signal Sbr is 
subjected to predetermined processing to extract the audio video 
stream Sav. This audio video stream Sav is output to the packing 
unit (not shown), the video attribute detector 107, and the audio 
attribute detector 109. The audio video stream Sav is output as 
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a program stream by the TS/PS conversion function of the 

broadcast receiver 102. 

In the packing unit, the audio video stream Sav is packed as 

described above, and the stream Sav corresponding to each pack is 

output as PCK data to the VOB composer 103. 

In the VOB composer 103, the audio video stream (PCK data) 

Sav is converted to VOB data Dvob (see figures 21(a)&(b) and 

22{a)&(b)) according to the format of the DVD recording standard, 
^ and then the VOB data Dvob is output to the recording signal 
; processor 104. 

{1 In the recording signal processor 104, the VOB data Dvob is 

N subjected ro addition of error correcting code and recording 
ij modulation, thereby generating a recording signal Sre 

□ corresponding to the VOB data Dvob. This recording signal Sre is 

□ written in a predetermined recording area of the optical disk 

^ (recording medium) 106 by the recording head 105 according to the 
write address information Iwa generated by the system controller 
111. 

In the video attribute detector 107, a video attribute of 
the video stream included in the audio. video stream Sav is 
detected by analyzing the header information of the video stream, 
and video attribute data Dva indicating the video attribute is 
output to the address information generator 108 and the VMG 
generator 110. 

On the other hand, in the audio attribute detector 109, an 



41 



audio attribute of the audio stream included in the audio video 
stream Sav is detected by analyzing the header information of the 
audio stream, and audio attribute data Daa indicating the audio 
attribute is output to the address information generator 108 and 
the VMG generator 110. 

In the address information generator 108, when at least one 
of the video attribute and the audio attribute changes, specific 



address information Isa indicating the write 



address at the time 



when the attribute change occurs is generatecj, on the basis of 
the write address information Iwa, the video attribute data Dva, 
and the audio attribute data Daa. The specific address 
information Isa is output to the VMG " generator 110. 

In the VMG generator 110, VMG inform.ation Dvmg, which is 
management information for each VOB, is generated on the basis of 
the video attribute information Dva, the audio attribute 
information Daa, and the specific address information Isa. This 
VMG information Dvmg is subjected to addition of error correcting 
code and recording modulation by the recording signal processor 
104, whereby a recording signal Sre corresponding to the VMG 
information Dvmg is generated. This recording signal Sre is 
written in the optical disk 106 by the recording head 105. The 
recording signal Sre corresponding to the VMG information Dvmg is 
written in a predetermined recording area of the recording medium 
106 after recording of the recording signal Sre corresponding to 
the VOB data Dvob is completed. At this time, the specific 
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address information Isa is written in the recording area 
corresponding to the VMGI lObi (see figure 19) . Further, the 
video attribute data Dva and the audio attribute data Daa are 

written in the V_ATR lOdl and the A_ATR 10d2 in the VMG 
information 10a, respectively (see figure 19) . 

As described above, the recording apparatus 100a according 
to the first embodiment of the invention is provided with the 
video attribute detector 107 for detecting the video attribute, 
n the audio attribute detector 109 for detecting the audio 
5 attribute, and the address information generator 108 for 
^ generating the specific address information Isa which indicates 
^ the write address at the time when the attribute change occurs, 
^ on the basis of the outputs from these detectors 107 and 109. 
O The specific address information Isa is written in the recording 
0 area of the optical disk 106 corresponding to the VMGI lObl which 
p is a component of the management information (VMG information) 
" 10a of each VOB. Therefore, when playing the audio video stream 
recorded on the optical disk 106, the recording position in the 
audio video stream, at which the attribute change occurs, can be 
recognized by reading the VMG information 10a, whereby quick 
access can be made to the recording position in the stream where 
the attribute change occurs on the optical disk. 

While in this first embodiment the specific address 
information .Isa indicating the data write address at the point of 
time vmen the video attribute or the audio attribute changes is 
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written on the recording medium, information relating to the 
recording time based on a reference time, at which the video 
attribute or the audio attribute changes, may be recorded on the 
recording medium instead of the specific address information Isa. 
[Embodiment 2] 

Figure 2 is a block diagram for explaining a recording 
apparatus 100b according to a second embodiment of the present 
invention . 

The recording apparatus 100b of this second embodiment 
includes a packing unit 112 and a padding size generator 113, 
instead of the packing unit of the first embcjdiment . The packing 
unit 112 performs the same packing process as described for the 
first embodiment. Further, when the audio attribute or the video 
attribute changes, the packing unit 112 inserts padding data in. 
the pack which is being formed, following the stream just before 
the attribute change, to prevent the stream before the attribute 
change and the stream after the attribute change from being 
stored in one pack. The padding size generator 113 calculates 
the size of the padding data on the basis of the video attribute 
data Dva, the audio attribute data Daa, and an internal signal 
Sop of the packing unit 112, and outputs size information Dps 
indicating the size to the packing unit 112. The padding data is 
also called stuffing data. 

Other constituents of the recording apparatus 100b are 
identical to those already described for the recording apparatus 
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100a of the first embodiment. 

Reference numeral 103b denotes a VOB composer according to 
this second embodiment, and the VOB composer 103b converts the 
PCK data Dpck from the packing unit 112 into VOB data Dvob 
according to the format of the video standard. 

Next, the operation of the recording apparatus 100b will be 
described . 

The audio video stream Sav supplied from the broadcast 
receiver 102 is divided into plural streams corresponding to data 
units (first data units) each having a predetlermined data size by 
the packing unit 112, and PCK data Dpck corresponding to each 
stream (pack) is output to the VOB composer 103b. At this time, 
the audio stream is output as audio PCK data (hereinafter also 
referred to simply as "audio pack")/ and the video stream is 
output as video PCK data (hereinafter also referred to simply as 
"video pack" ) . 

In the VOB composer 103, a predetermined number of audio 
packs and video packs equivalent to a predetermined display time 
are put together as a VOBU (third data unit) . Then, VOB data 
Dvob, which comprises a plurality of VOBUs equivalent to the 
audio video stream Sav inputted from the start of recording to 
the end of recording, is generated. 

The VOB data Dvob is converted into a recording signal Sre 
by the recording signal processor 104, and re^corded on the 
recording medium 106 by the optical head 105 according to the 
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write address Iwa. 

Further, the video attribute detector 107 detects the video 
attribute to output the video attribute data Dva, and the audio 
attribute detector 109 detects the audio attribute and to output 
the audio attribute data Daa. 

In the address information generator 108, specific address 
information Isa indicating the write address at the time when the 
audio attribute or the video attribute changes is generated on 
g the basis of the video attribute data Dva, the audio attribute 
m data Daa, and the write address information iwa. 
^ The padding size generator 113 receives the video attribute 

m data Dva, the audio attribute data Daa, and the internal signal 
^ Sop indicating the packing state in the packing unit 112. When 
"5 the video attribute or the audio attribute changes, the padding 
0 size generator 113 calculates the size of padding data, and 
B outputs the size information Dps indicating the data size. To be 
specific, when the packing unit 112 detects an attribute change 
while storing the stream (video stream or audio stream) in a 
specific pack, the padding size generator 113 calculates the 
vacant space of this pack at this point of time, as the size of 
padding data. 

When the data size information Dps is input to the packing 
unit 112, padding data is inserted in the vacant space of the 
specific pack, by an amount indicated by the size information Dps, 
instead of a portion of the stream after the position where the 



attribute change occurs. Thereby, even when the attribute change 
occurs during formation of the specific pack, the stream after 
the attribute change is not stored in this pack together with the 
stream before the attribute change. In other words, when the 
attribute change occurs, the stream before the attribute change 
and the stream after the attribute change are stored in adjacent 
different packs, respectively. To be specific, the stream after 
the attribute change is stored, from its beginning, in a pack 
which follows the specific pack. 

Thereafter, the same processes as those already described 
for the first embodiment are carried out and, finally, the 
recording signal Sre corresponding to the VMG information Dvmg of 
each VOB is recorded on the recording medium 106. 

As described above, the recording apparatus 100b of this 
second embodiment is provided with, instead of the packing unit 
of the first embodiment, the packing unit 112 for inserting 
padding data in the pack currently being formed when the audio 
attribute or the video attribute changes, and the padding size 
generator 113 which calculates the size of the padding data. In 
this recording apparatus 100b, when the attribute changes, 
padding data is inserted in the pack under formation, instead of 
the stream after the attribute change. Therefore, the stream is 
recorded such that the head of the stream after the attribute 
change is matched to the head of the pack. 

Accordingly, when playing the audio video stream recorded on 
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the optical disk 106, it is possible to recognize the recording 
position corresponding to the portion where the video or audio 
attribute changes, in the audio video stream whose recording 
addresses are managed in pack units, by reading the VMG 
information 10a, whereby quick access can be made to the 
recording position of the stream where the attribute change 
occurs, on the optical disk. 

While i.n this second embodiment the predetermined position 
of the stream and the head position of the pack are matched to 
each other by inserting the padding data in the pack, the method 

of matching the predetermined position of the stream to the head 

I 

position of the pack is not restricted thereto. For example, the 
size information of the pack data written in the pack header or 
the like may be changed. 

Further, in the first and second embodiments, both of the 
video attribute and the audio attribute are detected, and the 
specific address information Isa is generated according to 
changes in these attributes. However, only one of the video 
attribute and the audio attribute may be detected, and the 
specific address information Isa may be generated according to a 
change in the detected attribute. 
[Embodiment 3] 

Figure 3 is a block diagram for explaining a recording 
apparatus 100c according to a third embodiment of the present 
invention . 
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This recording apparatus 100c includes a VMG generator 110c 
instead of the address information generator 108 and the VMG 
generator 110 of the first embodiment. The generator 110c 
generates VMG information Dvmg, which is manc.gem.ent information 
for each VOB, on the basis of the video attribute data Dva and 
the audio attribute data Daa supplied from the attribute 
detectors 107 and 109, respectively. 

The recording apparatus 100c further includes a VOB composer 
103c instead of the VOB composer 103 of the ^irst embodiment. 
When either the audio attribute or the video attribute changes, . 
the VOB composer 103c generates VOB data so that the stream 
before the attribute change and the stream after the attribute 
change are separated as different VOB data, on the basis of the 
video attribute data Dva and the audio attribute data Daa. 

Other constituents of the recording apparatus 100c are 
identical to those already described for the recording apparatus 

100a of the first embodiment. 

Hereinafter, the operation of the recording apparatus 100c 

will be described. 

In this third embodiment, the broadcast signal Sbr from the 
antenna 101 is received by the broadcast receiver 102, and the 
audio video stream Sav from the receiver 102 is input to the VOB 
composer 103c, the video attribute detector 107, and the audio 
attribute detector 109. In the VOB composer 103c, the audio 
video stream Sav is converted to VOB data Dvob (see figures 
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21(a)&(b) and 22(a)&(b)) according to the format of the DVD 
recording standard. This VOB data Dvob is converted to a 
recording signal Sre by the recording signal processor 104, and 
the recording signal Sre is written in the optical disk 106 by 
the recording head 105. 

Further, in the video attribute detector 107, the video 
attribute is detected on the basis of the audio video stream Sav, 
and the video attribute data Dva is output to the VOB composer 
_ 103c and the VMG generator 110. In the audio attribute detector 
'5 109, the audio attribute is detected on the basis of the audio 
Ul video stream Sav, and the audio attribute data Daa is output to 
SJ the VOB composer 103c and the VMG generator 110. 
i:l The receiver 102, the VOB composer 103c, the recording 

^ ! 

□ signal processor 104, the recording head 105, and the attribute 
S detectors 107 and 109 operate in the same wa:^^ as described for 

the first embodiment. 
^ In this third embodiment, when the video attribute or the 

audio attribute changes during recording of the audio video 
stream Sav, the VOB composer 103c forms VOB data corresponding to 
the audio video stream Sav such that the stream before the 
attribute change and the stream after the attribute change are 
separated as different VOB data. 

In the VMG generator 110c, VMG information Dvmg as 
management information for recorded VOB data is generated, and 
the VMG information Dvmg is output to the recording signal 
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processor 104. In the processor 104, the VMG information Dvmg is 
subjected to addition of error correcting code and to recording 
modulation, thereby generating a recording signal Sre 
corresponding to the VMG information Dvmg, The recording signal 
Sre is recorded on the optical disk 106 by the optical head 105. 

As shown in figure 18, the VMG information Dvmg includes, as 
management information for each VOB, recording start address 
information, search information, video attribute information, and 
audio attribute information. The search information is 
information for searching a predetermined position in the 
recorded audio video stream. 

As described above, the recording apparatus 100c of this 
third embodiment is provided with the VOB composer 103c which 
generates VOB data such that, when either the audio attribute or 
the video attribute changes, the stream before the attribute 
change and the stream after the attribute change are separated as 
different VOB data. Therefore, the video attribute and the audio 
attribute can be unified for one VOB data. Accordingly, when 
playing the signal recorded on the optical disk 106, each VOB 
data can be decoded on the basis of the video attribute and the 
audio attribute which are managed in VOB units. 

Further, when playing the audio video stream, quick access 
can be made to the recording position where the attribute change 
occurs, in the stream recorded on the optical disk, by reading 
the VMG information Dvmg. 
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Further, in this third embodiment, both of the video 
attribute and the audio attribute are detected, and the VOB data 
is generated according to changes in these attributes. However, 
only one of the video attribute and the audio attribute may be 
detected, and the VOB data may be generated according to a change 
in the detected attribute. 
[Embodiment 4) 

Figure 4 is a block diagram for explaining a recording 
.f=i apparatus lOOd according to a fourth embodiment of the present 
S invention. ! 

^1! Like the recording apparatus 100a of the first embodiment, 

^ the recording apparatus lOOd receives a digital broadcast signal 
U Sbr, and records an audio video stream Sav obtained from the 
0 digital broadcast signal Sbr on a recording medium according to 
0 the format of the DVD recording standard. 

O To be specific, the recording apparatus lOOd includes a 

broadcast receiver 102 for receiving a digital broadcast signal 
Sbr from an antenna 101, and outputting an audio video stream 
Sav; a VOB composer 103 for converting the audio video stream Sav 
into VOB data Dvob according to the format of the DVD recording 
standard; a recording signal processor 110 for subjecting the VOB 
data Dvob to addition of error correcting code and to recording 
modulation, and outputting a recording signal Sre corresponding 
to the VOB data; and a recording head 105 for writing the 
recording signal Sre on a recording medium 106. Further, in the 
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recording apparatus lOOd, a packing unit (not shown) for packing 
the audio video 'stream Sav is provided between the broadcast 
receiver 102 and the V03 composer 103, and the VOB composer 103 
is supplied with PCK data as the audio video stream Sav. 

The antenna 101, the receiver 102, the VOB composer 103, the 
recording signal processor 104, the recording head 105, the 
recording medium 106, and the packing unit (not shown) are 
identical to those described for the first embodiment. 

The recording apparatus lOOd further includes a video 
resolution detector 107d for receiving the audio video stream Sav, 
detecting the video resolution by analyzing the header 
information of the video stream included in the audio video 
stream Sav, and outputting data Dvr indicating the video 
resolution (video resolution data) . 

The video resolution detector 107d detects, as the video 
resolution, at least one of the horizontal resolution, vertical 
resolution, and time resolution (frame frequency) . 

The horizontal resolution indicates the frame size in the 
horizontal resolution, and information such as 352, 480, 544, 704, 
720, 1440, or 1920 pixels is used as the frame size. , 

The vertical resolution indicates the frame size in the 
vertical resolution, and information such as ,240, 480, 576, 720, 
or 1080 lines is used as the frame size. 

The time resolution is indicated by the frame frequency, and 
a value such as 24, 30, 50, 59.97, or 60Hz is used as the value 
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of the frame frequency. 

The video resolution detector 107d may detect, as the time 
resolution, that the audio video stream Sav corresponds to either 
an interlace signal or a progressive signal. 

Further, the recording apparatus lOOd includes a system 
controller 111 for generating write address information Iwa which 
indicates an address of a recording area in the recording medium 
106 where the recording signal is to be written; an address 
information generator 108d for outputting specific address 
information Isa indicating the write address at the time when . the 
video resolution changes, on the basis of the video resolution 
data Dvr and the write address information Iwa; and a VMG 

i 

generator llOd for generating VMG information Dvmg that is 
management information for the VOB data, on the basis of the 
video resolution data Dvr from the detector 107d and the specific 
address information Isa from the address information generator 
108. 

When the video resolution of the audio video stream Sav 
changes, the specific address information Isa indicating the 
write address at the time when the resolution change occurs, is 
stored in the VMG information Dvmg, as described for the first 
embodiment . 

Next, the operation of the recording apparatus lOOd will be 
described. 

In this fourth embodiment, the broadcast signal Sbr from the 
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antenna 101 is received by the broadcast receiver 102; and the 
audio video stream Sav from the receiver 102 is input to the VOB 
composer 103 through the packing unit (not shown) , In the VOB 
composer 103, the audio video stream Sav is converted to VOB data 
Dvob (see figures 21(a)&{b) and 22(a)&(b)) according to the 
format of the DVD recording standard. This VOB data Dvob is 
converted to a recording signal Sre by the recording signal 
processor 104, and the recording signal Sre is written in the 
optical disk 106 by the recording head 105. 

The receiver 102, the VOB composer 103, the recording signal 
processor 1.04, the recording head 105, and the packing unit (not 
shown) operate in the same way as described for the first 
embodiment. | 

In the video resolution detector 107d, the video resolution 
is detected on the basis of the audio video stream Sav from the 
receiver 102, and video resolution data Dvr is output to the 
address information generator 108d and the VMG generator llOd. 

Further, in the system controller 111, j:he write address 
information Iwa for the data is generated. In the address 
information generator 108d, when the video resolution changes, 
the specific address information Isa indicating the write address 
at the time when the video the resolution change occurs, is 
output to the VMG generator llOd, on the basis of the output from 
the detector 107d and the write address information Iwa. 

In the VMG generator llOd, the VMG information Dvmg as 
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ma 



nagement information for each VOB is generated on the basis of 



the video resolution data Dvr and the output from the address 
information generator 108d. This VMG information Dvmg is 
subjected to addition of error correcting code and to recording 
modulation by the recording signal processor; 104, thereby 
generating a recording signal Sre corresponding to the VMG 



information Dvmg. This recording signal Sre 



is written in the 



optical disk 106 by the recording head 105. 

The recording signal Sre corresponding to the VMG 
information Dvmg is written in a predetermined recording area of 
the recording medium 106 after recording of the recording signal 
Sre corresponding to the VOB data Dvob is completed. At this 
time, the specific address information Isa is written as search 
information in the recording area corresponding to the VMGI lObl 
{see figure 19) . Further, the video resolution data Dvr is 

recorded in the V ATR lOdl in the VMG information 10a (see 

figure 19) . 

As described above, the recording apparatus lOOd according 



to the fourth embodiment of the invention is 
video resolution detector 107d for detecting 



provided with the 



the video resolution, 



and the address information generator 108d for generating the 
specific address information Isa which indicates the data write 
address at the time when the video resolution changes, on the 
basis of the output from the detector 107d. The specific address 

I 

information Isa is stored in the VMGI lObl which is a component 
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of the management information (VMG information) 10a of each VOB. 
Therefore/ when playing the audio video stream recorded on the 
optical disk 106, the recording position corresponding to the 
portion of the audio video stream where the ^ideo resolution 
changes can be recognized by reading the VMG information 10a, and 
this enables quick access to the position in j the recorded stream 
where the video resolution changes. 
[Embodiment 5] 

Figure 5 is a block diagram for explain-ing a recording 

i 

apparatus lOOe according to a fifth embodiment of the present 
invention. 

The recording apparatus lOOe of this fijfth embodiment 
includes a packing unit 112 and a padding size generator 113, 
instead of the packing unit (not shown) of the recording 
apparatus lOOd according to the fourth embodiment. The packing 
unit 112 performs the same packing process as described for the 
first embodiment. Further, when the video resolution changes, 
the packing unit 112 inserts padding data in the pack which is 
being formed at this time, following the stream just before the 
resolution change, to prevent the stream before the resolution 
change and the stream after the resolution change from being 
stored in one pack. The padding size generator 113 calculates 
the size of the padding data on the basis of the video resolution 
data Dvr and an internal signal Sop from the packing unit 112, 
and outputs size information Dsp indicating this size to the 
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packing unit 112. 

Other constituents of the recording appjaratus lOOe are 
identical to those already described for the '; recording apparatus 

lOOd of the fourth embodiment. ' 

i 

Reference numeral 103b denotes a VOB composer according to 
this fifth embodiment, and this VOB composer 103b converts the 
PCK data Dpck from the packing unit 112 into VOB data Dvob 
according to the format of the DVD recording standard, like the 
VOB composer 103 according to the fourth embodiment. 

Next, the operation of the recording apparatus lOOe will be 
described . 

When the audio video stream Sav supplied from the broadcast 
receiver 102 is input to the packing unit 112, it is divided into 
plural streams corresponding to data units (first data units) 
each having a predetermined data size, and PCK data Dpck 
corresponding to each stream (pack) is output to the VOB composer 
103b. At this time, the audio stream is output as audio PCK data 

(audio pack) , and the video stream is output 

(video pack) . 

In the VOB composer 103, a predetermined number of audio 
packs and video packs equivalent to a predetermined display time 
are put together as a VOBU (third data unit). Then, VOB data 
Dvob, which comprises a plurality of VOBUs equivalent to the 
audio video stream Sav inputted from the staft of recording to 
the end of recording, is generated. 



as video PCK data 
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The VOB data Dvob is converted into a recording signal Sre 
by the recording signal processor 104, and the recording signal 
Sre is recorded on the recording medium 106 by the optical head 
105 according to the write address Iwa. 

In the video resolution detector 107d, the video resolution 
is detected, and the video resolution data Dyr is output. In the 



address information generator 108d, specific 



address information 



Isa indicating the write address at the time when the video 
resolution changes is generated on the basis of the video 
resolution data Dvr and the write address inform.ation Iwa. 

The padding size generator 113 receives the video resolution 
data Dvr and the internal signal Sop indicating the packing state 
in the packing unit 112. When the video resolution changes, the 
padding size generator 113 calculates the size of padding data, 
and outputs information Dps (size information) indicating the 
data size. To be specific, when the resolution change is 
detected while the stream (video stream or aldio stream) is being 
stored in a specific pack by the packing unit 112, the vacant 
space of the pack at this point of time is calculated as the size 

I 
I 

of padding data. 

When the data size information Dps is input to the packing 
unit 112, padding data is inserted in the vacant space of the 
pack, by an amount indicated by the size information Dps, instead 
of a portion of the stream after the position where the 
resolution change occurs. Therefore, even when the resolution 
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change occurs during formation of the specific pack, the stream 
after the resolution change is not stored in this pack together 
with the stream before the resolution change. In other words, 
when the resolution change occurs, the stream before the 
resolution change and the stream after the resolution change are 
stored in adjacent different packs, respectiiely . That is, the 
stream after the resolution change is stored; from its beginning, 
in a pack which follows the specific pack. 

Thereafter; the recording apparatus lOOe operates in the 

! 

I 

same way as described for the recording apparatus lOOd of the 
fourth embodiment, and the recording signal Sre corresponding to 
the VMG information Dvmg of each VOB is recorded on the recording 
medium 10 6. 

As described above, the recording apparatus lOOe of this 
fifth embodiment is provided with, instead of the packing unit of 
the fourth embodiment, the packing unit 112 for inserting padding 
data in the pack under formation when the video resolution 
changes, and the padding size generator 113 for calculating the 
size of the padding data. When the resolution changes, the 
padding data is inserted in the pack under formation, instead of 
the stream after the resolution change. Therefore, the stream is 
recorded such that the head of the stream after the resolution 
change is matched to the head of the pack. 

Accordingly, when playing the audio video stream recorded on 
the optical disk 106, the recording position; corresponding to the 
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portion where the resolution changes, in the audio video stream 
whose recording addresses are managed in paclf units, can be 

i 

recognized by reading the VMG information 10a, and this enables 
quick access to the recording position of the audio video stream 
where the resolution change occurs on the optical disk. 

While in this fifth embodiment the predetermined position of 
the stream and the head position of the pack are matched to each 
other by inserting padding data in the pack, the method of 
matching the predetermined position of the stream to the head 
position of the pack is not restricted thereto. For example, the 
size information of the pack data written in 
the like may be changed. 
[Embodiment 6] 

Figure 6 is a block diagram for explaining a recording 
apparatus lOOf according to a sixth embodiment of the present 
invention . 



the pack header or 



a VMG generator llOf 
108d and the VMG 



This recording apparatus lOOf includes 
instead of the address information generator 

generator llOd of the fourth embodiment. The VMG generator llOf 
generates VMG information Dvmg which is management information 
for each VOB, on the basis of the video resolution data Dvr from 
the resolution detector 107d. 

The recording apparatus lOOf further includes a VOB composer 
103f instead of the VOB composer 103 of the fourth embodiment. 
When the video resolution changes, the VOB composer lG3f 



61 



generates VOB data so that the stream before the resolution 
change and the stream after the resolution change are separated 
as different VOB data, on the basis of the video resolution data 



Dvr . 



Other constituents of the recording apparatus lOOf are 



identical to those already described for the recording apparatus 
lOOd of the fourth embodiment. ' 

Hereinafter, the operation of the recording apparatus lOOf 



will be described. 

Tn this fifth embodiment, the broadcast 



signal Sbr from the 



an 



tenna 101 is received by the broadcast receiver 102, and the 



audio video stream Sav from the receiver 102 is input to the VOB 
composer 103f and the video resolution detector 107d. In the VOB 
composer 103f, the audio video stream Sav is | converted to VOB 
data Dvob (see figures 21(a)&(b) and 22(a)&(b)) according to the 
format of the DVD recording standard. This VOB data Dvob is 



conver 



ted to a recording signal Sre by the recording signal 



processor 104, and the recording signal Sre is written in the 
optical disk 106 by the recording head 105. 

Further, in the video resolution detector 107d, the video 
resolution is detected on the basis of the audio video stream Sav, 
and the video resolution data Dva is output to the VOB composer 
103f and the VMG generator llOf. 

The receiver 102, the VOB composer 103f, the recording 
signal processor 104, the recording head 105, and the video 



I 
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re 



solution detector lO'/d operate in the same way as described for 



the fourth embodiment. 

In this sixth embodiment, when the video resolution changes 
during recording of the audio video stream Sav, the VOB composer 
103f forms VOB data Dvob corresponding to the audio video stream 
Sav such that the stream before the resolutipn change and the 
stream after the resolution change are separated as different VOB 



data . 



In the VNG generator llOf, VMG information Dvmg which is 



management information for recorded VOB data: is generated, and 

I 

the VMG information Dvmg is output to the recording signal 
processor 104. In the processor 104, the VMG information Dvmg is 

subjected to addition of error correcting code and to recording 

I 

modulation, thereby generating a recording signal Sre 
corresponding to the VMG information Dvmg. jThe recording signal 
Sre is recorded on the optical disk 106 by the optical head 105. 

As shown in figure 18, the VMG information Dvmg includes, as 
management information for each VOB, recording start address 
information, search information, video attribute information such 



as VI 



Ldeo resolution information, and audio attribute information 



As described above, the recording apparatus lOOf of this 



sixth embodiment is provided with the VOB co 



■nposer 103f which 



generates VOB data so that, when the video resolution changes, 
the stream before the resolution change and the stream after the 
resolution change are separated as different VOB data. Therefore, 
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the video resolution can be unified for one VOB data. 
Accordingly, when playing the signal recorded on the optical disk 
106, decoding of each VOB can be performed on the basis of the 
video resolution which is managed in VOB units. 

Further, when playing the audio video stream recorded on the 
optical disk, reading the VMG information Dvn\g enables quick 
access to the recording position in the stream where the 
resolution change occurs. 
[Embodiment 7] 

Figure 7 is a block diagram for explaining a recording 
apparatus lOOg according to a seventh embodiment of the present 
invention . 

The recording apparatus lOOg includes ^n aspect ratio 
detector 107g and an address information generator 108g instead 
of the video resolution detector 107d and the address information 
generator .108d according to the fourth embodiment, respectively. 
The aspect ratio detector 107g receives an audio video stream Sav, 
detects the aspect ratio of the video stream included in the 

i 

audio vide stream Sav by analyzing the header information of the 
video stream, and outputs data Dar indicating the aspect ratio. 
The address information generator 108d generates specific address 
information Isa indicating the write address at the time when the 
aspect ratio changes, on the basis of the output Dar from the 
detector 107g and the write address information Iwa from the 
system controller 111. The specific address; information Isa and 
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the aspect ratio data Dar are output to the VMG generator 110 : 
Other constituents of the recording apparatu^ lOOg are identical 
to those of the recording apparatus lOOd according to the fourth 
embodiment. 

The aspect ratio detector 107g detects, as the aspect ratio, 
a ratio such as 16:9 or 4:3, the type of letter box, or the like. 

Next, the operation of the recording apparatus lOOg will be 
described . 

In this seventh embodiment, as in the fourth embodiment, the 
broadcast signal Sbr is received by the broadcast receiver 102, 
and the audio video stream Sav outputted from the receiver 102 is 
input to the VOB composer 103 through the packing unit (not 

! 

shown) . Further, the VOB data Dvob from the VO? composer 103 is 
converted to a recording signal Sre by the recording signal 
processor 104, and the recording signal Sre is written in the 
optical disk 106 by the recording head 105. 

The receiver 102, the VOB composer 103,j the packing unit 

i 

(not shown), the VOB composer 103, the recor(Jing signal processor 
104, and the recording head 105 operate in the same way as 
described for the fourth embodiment. 

In this seventh embodiment, in the aspect ratio detector 
107g, the aspect ratio data Dar indicating the aspect ratio of 
the video frame is detected by analyzing the header of the video 
stream included in the audio video stream Sav, and the aspect 
ratio data Dar is output to the address information generator 



108g and the VMG generator llOd. ! 

! 

Further, in the address information generator 108g, when the 
aspect ratio changes, the specific address information Isa 
indicating the write address at the time when the aspect ratio 
changes, is output to the VMG generator llOd, on the basis of the 
output Sar from the detector 107g and the write address 
information Iwa from the controller 111. 

In the VMG generator llOd, the VMG infoirmation Dvmg that is 
management information for each VOB is generated on the basis of 
the output Dar from the aspect ratio detector 107g and the output 
Isa from the address information generator 108g. This VMG 
information Dvmg is subjected to addition of error correcting 
code and to recording modulation by the recording signal 
processor 104, thereby generating a recording signal Sre 
corresponding to the VMG information Dvmg. This recording signal 
Sre is written in the optical disk 106 by the recording head 105. 

The recording signal Sre corresponding ito the VMG 
information Dvmg is written in a predetermined recording area of 
the recording medium 106 after recording of the recording signal 
Sre corresponding to the VOB data Dvob is completed. At this 
time, the specific address information Isa is written as search 
information in the recording area corresponding to the VMGI lObl 
(see figure 19) . Further, the aspect ratio data Dar is recorded 
in the V ATR lOdl in the VMG information IO4 (see figure 19) . 

As described above, the recording apparatus lOOg according 
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to the seventh embodiment of the invention is provided with the 
aspect ratio detector 107g for detecting the aspect ratio data 
Dar of the video frame, and the address information generator 
108g for generating the specific address information Isa which 
indicates the data write address at the time when the aspect 
ratio changes, on the basis of the aspect ratio data Dar from the 
detector 107g. The specific address information Isa is written 
in the recording area of the optical disk 106 corresponding to 
the VMGI lObl which is a component of the management information 
(VNG information) 10a of each VOB. Therefore, when playing the 
audio video stream recorded on the optical disk 106, the 

I 

recording position in the audio video stream, at which the aspect 
ratio changes, can be recognized by reading the VMG information 
10a, and this enables quick access to the position where the 
aspect ratio changes, in the stream recorded; on the optical disk. 
[Embodiment 8] 

Figure 8 is a block diagram for explaining a recording 
apparatus lOOh according to an eighth embodiment of the present 

invention. I 

i 

The recording apparatus lOOh of this eighth embodiment 

includes an aspect ratio detector 107g and ai[i address information 

i 

generator 108g instead of the video resolution detector 107d and 
the address information generator 108d according to the fifth 
embodiment. The aspect ratio detector i07g receives an audio 
video stream sav, detects the aspect ratio of the video stream 
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included in the audio vide stream Sav by analyzing the header 
information of the video stream, and outputs data Dar indicating 
the aspect ratio. The address information generator 108d 
generates specific address information Isa iridicating the write 
address at the time when the aspect ratio changes, on the basis 
of the output Dar from the detector 107g and the write address 
information Iwa from the system controller 111. The specific 
address information Isa and the aspect ratio data Dar are output 
to the VMG generator 110, and the aspect ratio data Dar is output 
to the packing unit 112 and the padding size • generator 113. 
Other constituents of the recording apparatus lOOg are identical 
to those of the recording apparatus lOOe according to the fifth 
embodiment . 

The aspect ratio detector 107g detects, as the aspect ratio, 
a ratio such as 16:9 or 4:3, the type of letter box, or the like. 

Next, the operation of the recording apparatus lOOh will be 
described. 

I 

In this eighth embodiment, the audio video stream Sav from 

the broadcast receiver 102 is input to the packing unit 112, 

t 

wherein the stream Sva is divided into plural streams 
corresponding to data units (packs) each having a predetermined 
data size by the packing unit 112, and PCK data Dpck 
corresponding to each pack is output to the VOB composer 103b. 
In the VOB composer 103b, a predetermined nuijaber of PCK data Dpck 
equivalent to a predetermined display time are put together as a 
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VOBU which is one data unit. Then, VOB data 
comprises a plurality of VOBUs equivalent to 



Dvob, which 



the audio video 



stream Sav inputted from the start of recordi^ng to the end of 
recording, is generated. 

The VOB data Dvob is converted into a recording signal Sre 
by the recording signal processor 104, and the recording signal 
Sre is recorded on the recording medium 106 by the optical head 



105 



In the aspect ratio detector 107g, the 



aspect ratio data Dar 



is detected, and the video resolution data DVr is output to the 
address information generator 108g, the padding size generator 



113, and the packing unit 112. 

In the address information generator 10 



Sg, specific address 



information Isa indicating the write address; at the time when the 
aspect ratio changes is generated on the basis of the aspect 
ratio data Dar and the write address informatfion Iwa from the 
system controller 111. 

When the aspect ratio changes, the padding size generator 
113 calculates the size of padding data on the basis of the 
internal signal Sop indicating the packing state of the packing 
unit 112, and outputs size information Dps indicating the data 
size. To be specific, when the aspect ratio change is detected 
on the basis of the aspect ratio data Dar while the stream is 
being stored in a specific pack, the vacant space of this pack at 



this point of time is calculated as the size i of padding data. 
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un 



When the data size information Dps is input to the packing 
it 112, padding data is inserted in the vacant space of the 



pack, by an amount indicated by the size information Dps, instead 
of a portion of the stream after the position where the aspect 
ratio changes. Therefore, even when the aspect ratio changes 

r 
I 
i 

during formation of the specific pack, the stream after the 
aspect ratio change is not stored in this padk ^together with the 
stream before the aspect ratio change. In other words, when the 
aspect ratio changes, the stream before the aspect ratio change 
and the stream after the aspect ratio change are stored in 
adjacent different packs, respectively. That is, the stream 
after the aspect ratio change is stored, from its beginning, in a 
pack which follows the specific pack. 

Thereafter, the recording apparatus lOOh operates in the 
same way as described for the recording apparatus lOOe of the 
fifth embodiment, and the recording signal Sre corresponding to 
the VMG information Dvmg of each VOB is recorded on the recording 

i 

medium 106. i 

The recording The recording signal Sre corresponding to the 
VMG data Dvmg is written in a predetermined recording area of the 
recording medium 106 after recording of the recording signal Sre 
corresponding to the VOB data Dvob is completed. At this time, 
the specific address information Isa is written as search 
information in the recording area corresponding to the VMGI lObl 
(see figure 19) . Further, the aspect ratio data Dar is recorded 
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in the V_ATR lOdl in the VMG information 10a (see figure 19) . 

As described above, the recording apparatus lOOh of this 
eighth embodiment is provided with the packing unit 112 which 
divides the audio video stream Sav into data units each having a 
predetermined data size. When the aspect ratio changes, padding 
data is inserted in the pack under formation] instead of the 
stream after the aspect ratio change. Therefore, the stream is 
recorded such that the head of the stream after the aspect ratio 
change is matched to the head of the pack. 

Accordingly, when playing the audio video stream recorded on 
the optical disk 106, the recording position : where the aspect 
ratio changes, in the audio video stream whose recording 
addresses are managed in pack units, can be recognized by reading 
the VMG information 10a, and this enables quick access to the 
position where the aspect ratio changes in the stream, recorded on 

the optical disk. 

While in this eighth embodiment the predetermined position 
of the stream and the head position of the pack are matched to 
each other by inserting padding data in the pack, the method of 
matching the predetermined position of the stream to the head 
position of the pack is not restricted thereto. For example, the 
size information of the pack data written in the pack header or 
the like may be changed. 
[Embodiment 9] 

Figure 9 is a block diagram for explaining a recording 
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apparatus lOOi according to a ninth embodiment of the present 



invention . 



The recording apparatus lOOi includes a:i aspect ratio 



detector 107g instead of the video resolutior 



detector 107d 



according to the sixth embodiment. The aspect ratio detector 
107g receives an audio video stream Sav, detects the aspect ratio 
of the video stream included in the audio vide stream Sav by 
analyzing the header information of the video stream, and outputs 
data Dar indicating the aspect ratio. The aspect ratio data Dar 
is output to the VOP composer 103f and the V^[G generator llOf. 
Other constituents of the recording apparatus lOOi are identical 
to those of the recording apparatus lOOf according to the sixth 
embodiment. 

The aspect ratio detector 107g detects, as the aspect ratio, 
a ratio such as 16:9 or 4:3, the type of letter box, or the like. 
Hereinafter, the operation of the recording apparatus lOOi 

will be described. 

In the recording apparatus lOOi, the broadcast signal Sbr is 
received by the broadcast receiver 102, and the audio video 
stream Sav outputted from the receiver 102 is input to the VOB 
composer 103f through the packing unit (not shown) . The VOP data 
Dvob from the VOP composer 103 is converted to a recording signal 
Sre by the recording signal processor 104, and the recording 
signal Sre is written in the optical disk 106 by the recording 
head 105. 



The receiver 102, the packing unit (not shown), the VOB 
composer 103f, the recording signal processor 104, and the 
recording head 105 operate in the same way as described for the 

* 

sixth embodiment. 

In this ninth embodiment, in the aspect ratio detector 107g, 

the aspect ratio data Dar indicating the aspect ratio of the 

I 

video frame is detected by analyzing the header of the video 

stream included in the audio video stream Sav, and the aspect 

ratio data Dar so detected is output to the yOP composer 103f and 

I 

the VMG generator lOlf. j 

In the VOB composer 103f, when the aspect ratio changes 
during recording of the audio video stream Sav, VOB data Dvob 
corresponding to the audio video stream Sav is formed so that the 
stream before the aspect ratio change and the stream after the 
aspect ratio change are separated as different VOB data. 



In the VMG generator llOf, VMG informat 



ion Dvmg as 



ma 



nagement information for recorded VOB data' is generated, and 



the VMG information Dvmg is output to the recording signal 
processor 104. In the processor 104, the Vm|; information Dvmg is 
subjected to addition of error correcting code and to recording 
modulation, thereby generating a recording signal Sre 
corresponding to the VMG information Dvmg. The recording signal 

i 

Sre is recorded on the optical disk 106 by tlie optical head 105. 

As shown in figure 18, the VMG information Dvmg includes, as 
management information for each VOB, recording start address 
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information, search information, video attribute information, and 
audio attribute information. 

As described above, the recording apparatus lOOi of this 
ninth erribodiment is provided with the VOB composer 103f which 

generates VOB data so that, when the aspect ratio changes, the 

i 

stream before the aspect ratio change and the stream after the 
aspect ratio change are separated as differer.t VOB data, as a VOB 
composer for converting the audio video stream Sav into VOB data 
according to the format of the DVD recording standard. Therefore, 
the aspect ratio can be unified for one VOB data. Accordingly, 
when playing the signal recorded on the optical disk 106, 
decoding of each VOB data can be performed on the basis of the 
aspect ratio which is managed in VOB units. 

Further, when playing the audio video stream, reading the 
VMG information Dvmg enables quick access to 
position in the stream where the aspect ratio changes. 

While in the first to ninth embodiments a digital broadcast 

signal is input to the recording apparatus, a broadcast signal to 

be input to the recording apparatus is not restricted thereto, 

and it may be an analog TV signal. 

I 

In this case, information relating to the video attribute, 
such as video resolution or aspect ratio, and information 
relating to the audio attribute are detected on the basis of 
information superposed in the vertical blanking period. 

Further, while in the first to ninth embodiments the output 



the recording 
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from the broadcast receiver 102 is recorded after converting it 
into data according to. the DVD recording standard, means for 
performing compressive coding on the output of the receiver 102 
may be provided and the output from this coding means may be 
recorded after converting it into data according to the DVD 
recording standard. 

Further, while in the first to ninth em|Dodiments information 
relating to the recording address of the point where the video 
attribute (e.g., video resolution or aspect ratio) or the audio 
attribute changes is recorded as the VMG information which is 
management information for each VOP, informatiion relating to the 
attribute change point is not restricted to tjhe address 
information. For example, the recording time at which the video 
or audio attribute changes, based on the recording start time, 
may be used as the VMG information. 

In this case, in order to make quick access to the recorded 
data corresponding to the predetermined recoiding time, 
information indicating a time map for associating the recording 
time with a recording address is required. i^ccording to the time 
map, the recording time is converted into th^ recording address, 
and recorded data corresponding to the obtained recording address 
is accessed. 
[Embodiment 10] 

Figure 10 is a block diagram for explaining a coding 
apparatus lOOj according to a tenth embodiment of the present 
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invention. 

I 

The coding apparatus lOOj is an apparatus for coding a video 
signal included in an audio video signal on t|he basis of the 
video attribute and the audio attribute. 

To be specific, the coding apparatus lOOj includes an intra- 
frame encoder 122a for subjecting a video signal Svi to intra- 
frame coding to generate first coded data Evl!, and an inter-frame 
encoder 122b for subjecting the video signal |Svi to inter-frame 
coding to generate second coded data Ev2. ' 

The intra-frame encoder 122a subjects the video signal Svi 
of a frame to be processed to intra-frame coding using only data 
within this frame. For example, the encoder' 122a performs 1 
ij frame coding base on MPEG. The inter-frame encoder 122b subjects 
J the video signal Svi corresponding to a target frame to be 
5 processed to inter-frame predictive coding with reference to 
^ image data of an already processed frame other than the target 
frame. For example, the encoder 122b perforns P or B frame 
coding based on MPEG. | 

The coding apparatus lOOj further includes an input-side 
switch 121 for supplying the video signal Svi to either the 
encoder 122a or the encoder 122b according to a control signal 
Sent, and an output-side switch 123 for selecting either the 
first coded data Evi or the second coded data Ev2 according to 
the control signal Sent, and outputting the selected coded data 
as a video stream Dstr. : 



• 
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The input-side switch 121 has an input terminal 121a to 
which the video signal Svi is applied, a first output terminal 
121b for supplying the video signal Svi to tHe intra-frame 
encoder 122a, and a second output terminal 121c for supplying the 
video signal Svi to the inter-frame encoder 122b. The input-side 
switch 121 connects the input terminal 121a t'o either the first 
output terminal 121b or the second output terminal 121c according 
to the switch control signal Sent. The output-side switch 123 
has a first input terminal 123a to which the |first coded data Evl 
is applied, a second input terminal 123b to which the second 
coded data Ev2 is applied, and an output terminal 123c for 
outputting the video stream Dstr. The output-side switch 123 
connects either the first input terminal 123^ or the second input 
terminal 123b to the output terminal 123c according to the switch 

control signal Sent. 

The coding apparatus lOOj further includes a video attribute 
detector 124 and an audio attribute detector 125. The video 
attribute detector 124 detects the video attribute on the basis 
of the video signal Svi included in the audio video signal, and 

I 



outputs video attribute data Dva. The audio 
125 detects the audio attribute on the basis 



attribute detector 
of the audio signal 



Sau included in the audio video signal, and outputs audio 

attribute data Daa. 

Further, the coding apparatus lOOj includes a coding 
controller 126 and a prediction mode controller 127. The coding 
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controller 126 outputs the switch control signal Sent to the ' 
respective switches 121 and 123 on the basis of the video 
attribute data Dva and the audio attribute data Daa. The 
prediction mode controller 127 outputs a codijng control signal 
Pent for controlling inter-frame coding, to the inter-frame 
encoder 122b, on the basis of the video attribute data Dva and 
the audio attribute data Daa. 

* 

with reference to figure 17, in the state where there is no 
change in the video attribute and the audio attribute, the coding 
controller 126 controls the input-side and output-side switches 
121 and 123 so that intra-frame coding and inter-frame coding are 
performed cyclically, thereby forming a GOP cjomprising a 
predetermined number of frames. On the otheij hand, when the 
video attribute or the audio attribute changes, the coding 
controller 126 controls the input-side and output-side switches 
121 and 123 so as to change the cycles of the intra-frame coding 
and the inter-frame coding, thereby matching the head of the 
stream after the video or audio attribute cha,nge to the head of 
the stream constituting the GOP. 

In the state where there is no change in the video attribute 
and the audio attribute, the prediction mode controller 127 
controls the inter-frame encoder 122b so that B-fram.e coding is 
carried out by using, as reference frames, two frames positioned 
before and after the target B frame. On the other hand, when the 
video attribute or the audio attribute change;S, the prediction 
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mode controller 127 controls the inter-frame encoder 122b so that 

I 

B-frame coding is carried out without using, as a reference frame, 



a frame included in an already processed GOP 



whose video 



attribute or audio attribute is different from that of a specific 
containing the target frame. The already processed GOP is a GOP 
which has been subjected to coding for each frame before coding 

of the specific GOP. 

In order to place the frame immediately: before the video 
attribute change as the last frame in the GOP, the types of 
frames constituting the GOP may be adjusted by continuously 
performing coding so that the last several frames in the GOP are 
P frames or I frames. 



H 



ereinafter, the operation of the codinn apparatus lOOj will 



be described. 

When an audio video signal is input to the coding apparatus 
100 j, a video signal Svi included in the audio video signal and 
corresponding to each frame is applied to either the intra-frame 



encoder 122a or the inter-frame encoder 122b 
side switch 121. 



through the input- 



in the intra-frame encoder 122a, the video signal Svi of the 
target frame is subjected to intra-frame coding without referring 
to image data of another frame, thereby generating first coded 

I 

data (intra-frame coded data) Evl . That is, in the intra-frame 
encoder 122a, the video signal Svi is independently coded using 
only the image data included in the target frame. To be specific, 



I 
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l-frame coding based on MPEG is carried out. On the other hand, 

in the inter-frame encoder 122b, the video signal Svi of the 
target frame is coded with reference to image data of another 
frame, thereby generating second coded data (inter-frame coded 
data) Ev2, That is, in the inter-frame encoder 122b, the video 
signal Svi of the target frame is subjected to inter-frame 
predictive coding using image data of a predetermined frame as a 
reference frame. To be specific, P or B frame coding based on 
f=r MPEG is carried out. 

^ The coded data generated in each encoder is output as a 

Hi video stream Dstr through the output-side swj.tch 123a. 

In the video attribute detector 124, the video attribute of 
yJ the video signal Svi included in the inputted audio video signal 
y is detected, and video attribute data Dva is output to the coding 
O controller 126 and the prediction mode controller 127. In the 
h audio attribute detector 125, the audio attribute of the audio 
signal Sau included in the inputted audio video signal is 
detected, and audio attribute data Daa is output to the coding 
controller 126 and the prediction mode controller 127. 

In the coding controller 126, a control signal Sent is 
output to the input-side and output side switches 121 and 123 on 
the basis of the video attribute data Dva and the audio attribute 
data Daa, and the switches 121 and 123 are c9ntrolled so that the 
video signal Svi of the target frame is subjected to either 
intra-frame coding or inter-frame coding. 
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For example, when there is no change in the video attribute 
and the audio attribute, the switches 121 and 123 are controlled 
so that intra-frame coding and inter-frame coding are cyclically 
performed as shown in figure 17, whereby a GOP comprising a 
predetermined number of frames is constituted. On the other hand, 
when the video attribute or the audio attribute changes, the 
switches 121 and 123 are controlled so that the head of the 
stream after the attribute change is matched to the head of the 
stream constituting the GOP, regardless of the cycles of intra- 
frame coding and inter-frame coding. 

In the prediction mode controller 127, when there is no 
change in the video attribute and the audio attribute, the inter- 
frame encoder 122b is controlled so that B-frame coding is 
carried out by using, as reference frames, t^o frames positioned 
before and after the target B frame. On the other hand, when the 
video attribute or the audio attribute changes, the inter-frame 
encoder 122b is controlled so that B-frame coding is carried out 
without using, as a reference frame, a frame included in an 
already processed GOP whose video attribute or audio attribute is 
different from that of a specific GOP including the target frame. 

As described above, the coding apparatus lOOj of this tenth 
embodiment is provided with the coding controller 12 6 for 
deciding that either intra-frarue coding or inter-frame coding is 
performed on the video signal Svi of each frame, on the basis of 
the video attribute data Dva and the audio attribute data Daa, 
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and the prediction mode controller 127 for controlling the 
prediction mode of inter-frame coding on the basis of the 
attribute data Dva and Daa. When the video attribute or the 
audio attribute changes, the coding mode and the prediction mode 
are controlled so that the head of the. stream after the attribute 
change is matched to the head of the stream constituting the GOP 
and, further, a frame included in a GOP whose attribute is 
different from that of the GOP including the target frame is not 
used as a reference frame. Therefore, a video signal whose video 
attribute (e.g., coding mode, video resolution, or video aspect 
ratio) changes, can be coded according to the coding method based 
on MPEG. 

That is, in the coding apparatus lOOj o 
embodiment, even when the video attribute or 
changes, since the stream of the first frame after the attribute 
change is matched to the stream of the head frame of the GOP, it 
is possible to make access to the video or audio attribute change 
ooint in the video stream recorded on the recording medium, with 

A. 

the GOP as the access unit. 

Further, since a frame included in a GOP whose video or 
audio attribute is difference from that of th. 
not used as a reference frame for the target frame, independent 
coding or decoding can be performed on each of the GOPs before 
and after the attribute change point and, therefore, coding and 
decoding can be performed without failure even when the video or 



t this tenth 

the audio attribute 



e target frame is 
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audio attribute changes. 
[Embodiment 11] 

. i 

Figure 11 is a block diagram for explaining a coding 
apparatus 100k according to an eleventh embodiment of the present 
invention . 

This coding apparatus 100k includes a packing unit 128 in 
addition to the constituents of the coding apparatus lOOj 
according to the tenth embodiment. The packing unit 128 subject 
the video stream Dstr outputted from the output-side switch 123 
to packing on the basis of the video attribute data Dva and the 
audio attribute data Daa, and outputs the packed video stream 
Dpck. The packing process is to divide the video stream Dstr 
into streams corresponding to data units (packs) each having a 
predetermined size. 

In the state where there is no change in the video attribute 

and the audio attribute, the packing unit 128 performs packing on 

the video stream Dstr so that the video stream Dstr is divided 

into streams corresponding to data units (packs) each having a 

predetermined size. On the other hand, when the video attribute 

I 

or the audio attribute changes, the packing unit 128 performs 
packing on the video stream Dstr so that the head of the stream 
after the video or audio attribute change is matched to the head 
of the stream stored in the pack. 

More specifically, when an attribute change occurs in the 
state where the stream is being stored in a specific pack, the 
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I 

packing unit 128 inserts predetermined padding data in this pack 
instead of the stream after the attribute change. The method for 
storing only the streams of the same attribute in the pack when 
an attribute change occurs is not restricted to the above- 
mentioned method of inserting predetermined padding data instead 
of the stream after the attribute change. For example, when the 
attribute changes, the pack size in the header information of the 
pack may be changed to prevent the stream after the attribute 
change from being included in this pack, following the stream 
before the attribute change. 

Other constituents of the coding apparatus 100k are 
identical to those of the coding apparatus lOOj of the tenth 
embodiment. 

I 

Next, the function and effect will be described. 

In the coding apparatus lOOk of this eleventh embodiment, 
like the coding apparatus lOOj of the tenth embodiment, when the 
video attribute or the audio attribute changes, coding of the 
video signal is performed so that the stream of the first frame 
after the attribute change is matched to the stream of the head 

frame of the GOP. 

Then, in the packing unit 128, the packjing process of 
dividing the video stream into packs of a predetermined size is 
performed so that the video or audio attribute change point in 
the stream is matched to the head of the pack. To be specific, 
when the attribute change occurs while the stream is being stored 
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in a specific pack, predetermined padding data is inserted in 
this pack instead of the stream after the attribute change. 

As described above, the coding apparatus 100k of this 
eleventh embodiment is provided with the packing unit 128 in 
addition to the constituents of the tenth embodiment, and when an 
attribute change occurs while the stream is being stored in a 
specific pack, this packing unit 128 inserts predetermined 
padding data in this pack instead of the stream after the 
attribute change. Therefore, it is possible to make quick access 
to the change point of the video attribute, such as the video 

resolution, in the pack data Dpck which is recorded on the 

I 

recording medium according to address management in pack units. 
[Embodiment 12] 

Figure 12 is a block diagram for explaining a coding 
apparatus 100m according to a twelfth embodiment of the present 
invention . 

The coding apparatus 100m includes a video resolution 
detector 129 instead of the video attribute detector 124 and the 
audio attribute detector 125 of the coding a^)paratus lOOj 
according to the tenth embodiment. The video resolution detector 
129 detects the video resolution on the basis of the video signal 
Svi included in the audio video signal, and outputs video 
resolution data Dvr. Preferably, the video resolution detector 
129 detects, as the video resolution, at least one of the 
horizontal frame size, vertical frame size, and frame frequency, 
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like the video resolution detector 107d according to the fourth 
embodiment. However, the detector 129 may detect, as the video 
resolution, that the video signal is either an interlace signal . 
or a progressive signal. 

Further, the coding apparatus 100m includes a coding 
controller 126m and a prediction mode controller 127m instead of 
the coding controller 126 and the prediction mode controller 127 
of the coding apparatus lOOj according to the: tenth embodiment. 
The coding controller 126m controls the respective switches 121 
and 123 by using a switch control signal Sent on the basis of the 
video resolution data Dvr, and the prediction mode controller 
127m controls the inter-frame encoder 122b by using a coding 
control signal Pent on the basis of the video resolution data Dvr. 

With reference to figure 17, in the state where there is no 
change in the video resolution, the coding controller 126m 
controls the switches 121 and 123 so that intra-frame coding and 
inter-frame coding are performed cyclically. On the other hand, 
when the video resolution changes, the coding controller 126m 
controls the switches 121 and 123 so as to change the cycles of 
intra-frame coding and inter-frame coding, thereby matching the 
head of the stream after the resolution change to the head of the 
stream constituting the GOP. 

In the state where there is no change in the video 
resolution, the prediction mode controller 127m controls the 
inter-frame encoder 122b so that B-frame coding is carried out by 
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using, as reference frames, two frames positioned before and 
after the target B frame. On the other hand, when the video 
resolution changes, the prediction mode controller 127m controls 
the xnter-frame encoder 122b so that B-frame coding is carried 
out without usxng, as a reference frame, a frame included in an 
already processed GOP whose video resolution is different from 

that of a specific GOP including the target frame. 

Other constituents of the coding apparatus 100m are 

identical to those of the coding apparatus 100, of the tenth 

embodiment . 

Next, the operation of the coding apparatus 100m will be 

described. 

Figure 13 shows a TV signal (video signal) inputted to the 

■ coding apparatus 100m. 

in figure 13, the vxdeo signal up to a frame F{j-3) is a 
high-vision signal, and the subsequent video signal from a fram.e 
F(j-2) xs a standard TV signal. That is, the frame F(j-2) is a 

^•r,^ t-n rhP Dosition where the video resolution 
frame corresponding to tne posiuj-uu 

T Tn fimire 13, Fd'S) and F(3-4) are 
changes in the video signal. In figure 13, U 

^A^rr 1-hp. hiah-vision signal, and F(j-1)~ 
frames corresponding to the nign vxa ^ | 

P(j.9) are frames corresponding to the standard TV signal. 

When the video signal shown in figure 13 is input to the 
coding apparatus 100m, the video signal is coded by either the 
intra-frame encoder 122a or the inter-frame encoder 122b 
according to the video resolution and the coding mode, and a 
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video stream Dstr obtained in the coding process is output. The 
coding mode is information indicating that each frame is to be 
subjected to any of I-frame coding, P-frame coding, and B-frame 
coding, on the basis of the video signal. 

Hereinafter, a brief description will be given of the 
operations of the video resolution detector 129, the coding 
controller 126m, and the prediction mode controller 127m when the 
video signal shown in figure 13 is input to the coding apparatus 
100m. 

I 

The video resolution detector 129 detects the video 
resolution on the basis of the inputted video signal Svi, and 
outputs video resolution data Dvr to the coding controller 126m 
and the prediction mode controller 127m, 

Then, the coding controller 126m controls the switches 121 
and 123 so that one GOP is completed at the frame F(j-3) and a 
new GO? is constituted from the next frame F(j-2) . Thereby, all 
the frames constituting one GOP have the same video resolution. 
In other words, frames having different video resolutions are not 

mixed in one GOP. 

Further, the prediction mode controller! 127m controls the 
inter-frame encoder 122b so that only the I fram.e F(j) is used as 
a reference frame when performing inter-fraiue coding on the B 
frames F(j-2) and F(j-l) . 

As described above, the coding apparatus 100m according to 
the twelfth embodiment is provided with the video resolution 
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detector 129 for detecting the video resolution on the basis of 
the video signal, the coding controller 126Tn ifor deciding that 
the video signal Svi of each frame is to be subjected to either 
intra-frame coding or inter-fraiue coding on the basis of the 
video resolution data Dvr, and the prediction mode controller 127 
for controlling the prediction mode of inter-^frame coding on the 
basis of the video resolution data Dvr. Thereby, the video 
signal is separated into two GOPs at the vid^o resolution change 
point and, further, each frame in the GOP, whose head frame 
corresponds to the video resolution change point, can be coded 
without referring to a frame of the previous GOP. Therefore, a 
video signal whose video resolution changes can be coded 
according to the MPEG coding method. 

That is, in the coding apparatus 100m, even when the video 
attribute changes, since the stream of the first frame after the 
resolution change is matched to the stream of the head frame of 

i 

the GOP, it is possible to make quick access | to the video 

I 

resolution change point in the video stream vyhich is recorded on 
the receding medium with each GOP as an access unit. 

Further, since a frame of a GOP whose video resolution is 
different from that of the target frame is not used as a 
reference frame for the target frame, independent coding or 
decoding can be performed on each of the GOPs before and after 
the video resolution change point, whereby coding and decoding 
can be performed without failure even when the video resolution 
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changes . 

While in this twelfth embodiment the head frame of the first 
GOP (specific GOP) after the video resolution change is a B frame, 
the first frame of the specific GOP may be an I frame. Also in 
this case, when performing inter-frame coding on the specific GOP, 
a frame of a GOP whose video resolution is different from that of 
the specific GOP is not used as a reference f ram.e . 

Further, in order to match the frame immediately before the 
, video resolution change to the last frame in , the GOP previous to 
i the specific GOP, the type of each frame may be controlled by 
! continuously performing coding in which the last some frames in 
i the previous GOP are P frames or I frames, 
j Further, while in this twelfth embodiment coding is 

3 performed such that two 3 frames are placed between adjacent I 
] frame and P frame and between adjacent two P frames, the number 
5 of B frames is not restricted thereto. For example, these B 
frames may be dispensed with. 

[Embodiment 131 

Figure 14 is a block diagram for explaining a coding 
apparatus lOOn according to a thirteenth embodiment of the 

present invention. 

This coding apparatus lOOn includes a packing unit 128n in 
addition to the constituents of the coding apparatus 100m 
according to the twelfth embodiment. The packing unit 128n 
subject the video stream Dstr outputted from the output-side 
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switch 123 to packing on the basis of the video resolution data 
Dvr, and outputs the packed video stream Dpck. The packing 
process is to divide the video stream Dstr into streams 
corresponding to data units (packs) each having a predetermined 
size . 

The packing unit 12an is identical to the packing unit 128 
according to the eleventh embodiment except that the unit 128n 
receives the video resolution data Dvr while the unit 128 
receives the video attribute data Dva and the audio attribute 
data Daa. 

i 

That is, in the state where there is no; change in the video 
resolution, the packing unit 128n performs packing on the video 
stream Dstr so that the video stream Dstr is 'divided into streams 
corresponding to data units (packs) each having a predetermined 
size. On the other hand, when the video resolution changes, the 
packing unit 128n performs packing on the video stream Dstr so 

that the head of the stream after the resolution change is 

I 

matched to the head of the stream stored in ^he pack. 

More specifically, when an attribute change occurs in the 
state where the stream is being stored in a specific pack, the 
packing unit 128n inserts predetermined padding data in this pack 
instead of the stream after the attribute change. 

Other constituents of the coding apparatus lOOn are- 
identical to those of the coding apparatus 100m according to the 
twelfth embodiment. 
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Next, the function and effect will be described. 

In the coding apparatus lOOn of this thirteenth embodiment, 
like the coding apparatus 100m of the twelfth embodiment, when 
the video resolution changes, coding of the video signal is 
performed so that the stream of the first frame after the 
resolution change is matched to the stream of the head frame of 
the GOP. 

Then, in the packing unit 128n, the packing process of 
dividing the video stream into packs of a predetermined size is 
performed so that the video resolution change point in the stream 
is matched to the head of the pack. To be specific, when the 
attribute change occurs while the stream is being stored in a 
specific pack, predetermined padding data is inserted in this 
pack instead of the. stream after the resolution change. 

As described above, the coding apparatus lOOn of this 
thirteenth embodiment is provided with the packing unit 128n in 
addition to the constituents of the twelfth embodiment, and when 
the video resolution changes while the stream is being stored in 
a specific pack, this packing unit 128n inserts predetermined 
padding data in this pack instead of the stream after the 
resolution change. Therefore, it is possible to make quick 
access to the video resolution change point in the pack data Dpck 
which is recorded on the recording medium according to address 
management in pack units. 
[Embodiment 14] 
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Figure 15 Is a block diagram illustrating a coding apparatus 

I 

lOOp according to a fourteenth embodiment of the present 

I 
I 

invention. 

The coding apparatus lOOp includes an aspect ratio detector 
130 instead of the video attribute detector 124 and the audio 
attribute detector 125 of the coding apparatus lOOj according to 
the tenth embodiment. The aspect ratio detector 130 detects the 
aspect ratio on the basis of the video signal Svi included in the 
audio video signal, and outputs aspect ratio data Dar. The 
aspect ratio detector 130 detects the aspect ratio by reading 
aspect ratio information which is embedded in the vertical 
blanking period of the video signal. Further, the aspect ratio 
detector 130 detects the value of the aspect ratio (16:9 or 4:3), 
the letter box information, or the like. 

Further, the coding apparatus lOOp includes a coding 
controller 126p and a prediction mode controller 127p instead of 
the coding controller 126 and the prediction mode controller 127 
of the coding apparatus lOOj according to the tenth embodiment. 
The coding controller 126p controls the respective switches 121 
and 123 by using a switch control signal Sent on the basis of the 
aspect ratio data Dar, and the prediction mode controller 127p 
controls the inter- frame encoder 122b by using a coding control 
signal Pent on the basis of the aspect ratio data Dar. 

With reference to figure 17, in the state where there is no 
change in the aspect ratio, the coding controller 126p controls 
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the switches 121 and 123 so that intra-frame coding and inter- 
frame coding are performed cyclically. On the other hand, when 
the aspect ratio changes, the coding controller 126p controls the 
switches 121 and 123 so as to change the cycles of intra-frame 
coding and inter-frame coding, thereby matching the head of the 
stream after the aspect ratio change to the head of the stream 
constituting the GOP. 

In the state where there is no change in the aspect ratio, 
the prediction mode controller 127p controls the inter-frame 
encoder 122b so that B-frame coding is carried out by using, as 
reference frames, two frames positioned before and after the 
target B frame. On the other hand, when the aspect ratio changes, 
the prediction mode controller 127p controls the inter-fram.e 
encoder 122b so that B-frame coding is carried out without using, 
as a reference frame, a frame included in an already processed 
GOP whose aspect ratio is different from that of a specific GOP 
including the target frame. 

Other constituents of the coding apparatus lOOp are 

identical to those of the coding apparatus IGOj of the tenth 

embodiment . j 

Next, the operation of the coding apparatus lOOp will be 

described . 

When the video signal Svi is input to the coding apparatus 
lOOp, the video signal Svi is coded by either the intra-frame 
encoder 122a or the inter-frame encoder 122b according to the 
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change of the aspect ratio, and a video stream Dstr obtained in 
the coding process is output. 

That is," the aspect ratio detector 130 detects the aspect 
ratio on the basis of the inputted video signal Svi, and outputs 
aspect ratio data Dar to the coding controller 126p and the 
prediction mode controller 127p. 

The coding controller 125p controls the switches 121 and 123 
so that one GOP is completed at the frame just before the aspect 
ratio change and a new GOP is constituted from the next frame. 
Thereby, all the frames constituting one GOP have the same aspect 
ratio. In other words, frames having different aspect ratios are 

not mixed in one GOP. 

The prediction mode controller 127p controls the inter-frame 
encoder 122b so that a frame of a GOP whose aspect ratio is 
different from that of the target frame is not used as a 
reference frame for the target frame. 

As described above, the coding apparatus lOOp according to 
the fourteenth embodiment is provided with the aspect ratio 
detector 130 for detecting the aspect ratio on the basis of the 
video signal, the coding controller 126p for deciding that the 
video signal Svi of each frame is to be subjected to either 
intra-frame coding or inter-frame coding on the basis of the 
aspect ratio data Dar, and the prediction mode controller 127p 
for controlling the prediction mode of inter-frame coding on the 
basis of the aspect ratio data Dar. Thereby, the video signal is 



separated into two GOPs at the aspect ratio change point and, • 
further, each frame in the GOP, whose head frame corresponds to 
the aspect ratio change point, can be coded Without referring to 
a frame in the previous GOP, Therefore, a video signal whose 
aspect ratio changes can be coded according to the MPEG coding 
method . 

That is, in the coding apparatus lOOp, even when the aspect 

ratio changes, since the stream of the first frame after the 

aspect ratio change is matched to the stream of the head frame of 

the GOP, quick access can be made to the aspect ratio change 

point in the video stream which is recorded on the receding 

I 

medium with each GOP as an access unit. 

Further, since a frame of a GOP whose aspect ratio is 
different from that of the target frame is not used as a 
reference frame for the target frame, independent coding or 
decoding can be performed on each of the GOPs before and after 
the aspect ratio change point. Therefore, coding and decoding 
can be perform.ed without failure even when the aspect ratio 
changes . 

While in this fourteenth embodiment the head frame of the 
first GOP (specific GOP) after the aspect ratio change is a B 
frame, the first frame of the specific GOP may be an I frame. 
Also in this case, when performing inter-frame coding on the 
specific GOP, a frame in a GOP whose aspect ratio is different 
from that of the specific GOP is not used as a reference frame. 



Further, in order to match the frame immediately before the 
aspect ratio change to the last frame in the GOP previous to the 
specific GOP, the type of each frame may be controlled by 
continuously performing coding such that the last some frames in 
the previous GOP are P frames or I frames. 

Further, while in this fourteenth embodiment coding is 
performed such that two B frames are placed between adjacent I 
frame and P frame and between adjacent two P |frames, the number 
of B frames is not restricted thereto. For example, these B 
frames may be dispensed with. 
[Embodiment 15] 

Figure 16 is a block diagram for explaining a coding 
apparatus lOOq according to a fifteenth embodiment of the present 
invention . 

This coding apparatus lOOq includes a packing unit 128q in 
addition to the constituents of the coding apparatus lOOp 
according to the fourteenth embodiment. The packing unit 128q 
subject the video stream Dstr outputted from the output-side 
switch 123 to packing on the basis of the aspect ratio data Dar, 
and outputs the packed video stream Dpck. The packing process i 
to divide the video stream Dstr into streams ; corresponding to 
data units (packs) each having a predetermined size. 

The packing unit 128q is identical to the packing unit 128 
according to the eleventh embodiment except that the unit 128q 
receives the aspect ratio data Oar while the unit 128 receives 
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the video attribute data Dva and the audio attribute data Daa. 

That is, in the state where there is no change in the aspect 
ratio, the packing unit 128q performs packing on the video stream 
Dstr so that the video stream Dstr is divided into streams 
corresponding to data units (packs) each having a predetermined 
size. On the other hand, when the aspect ratio changes, the 
packing unit 128q performs packing on the video stream Dstr so 
that the head of the stream after the aspect ratio change is 
matched to the head of the stream stored in the pack. 

More specifically, when the aspect ratio changes in the 
state where the stream is being stored in a specific pack, the 
packing unit 128q inserts predetermined padding data in this pack 
instead of the stream after the aspect ratio change. 

Other constituents of the coding apparatus lOOq are 
identical to those of the coding apparatus 100k according to the 

fourteenth embodiment. 

Next, the function and effect will be described. 

In the coding apparatus lOOq of this fifteenth embodiment, 
like the coding apparatus lOOp of the fourteenth embodiment, when 
the aspect ratio changes, coding of the video signal is performed 
so that the stream of the first frame after the aspect ratio 
change is matched to the stream of the head frame of the GOP. 

Then, in the packing unit 128q, the packing process of 
dividing the video stream into packs of a predetermined size is 
performed so that the aspect ratio change point in the stream is 
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matched to the head of the pack. To be specific, when the aspect 
ratio changes while the stream is being stored in a specific pack, 
predetermined padding data is inserted in thijs pack instead of 
the stream after the aspect ratio change. 

As described above, the coding apparatus lOOq of this 
fifteenth embodiment is provided with the packing unit 128q in 
addition to the constituents of the fourteenth embodiment, and 
when the aspect ratio changes while the stream is being stored in 
^ a specific pack, this packing unit 128q inserts predetermined 
[ padding data in this pack instead of the stream after the aspect 
^ ratio change. Therefore, it is possible to make quick access to 
^ the aspect ratio change point in the pack data Dpck which is 
^ recorded on the recording medium according to address management 
^ in pack units. 

I The recording apparatuses according to the first to ninth 

E embodiments and the coding apparatuses according to the tenth to 
fifteenth embodiments can be implemented by software in a 
computer system, with the same effects as described above. 

Further, while in the first to ninth embodiment an optical 
disk is described as a recording medium, a recording medium on 
which an audio video stream is recorded is not restricted thereto. 
Any recording medium may be employed so long as it can store 
digital data. 



